This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | Next revision Both sides next revision | ||
spark [2019/02/27 10:55] mantis [Providing spark jars] |
spark [2019/02/27 10:56] mantis [Providing spark jars] |
||
---|---|---|---|
Line 127: | Line 127: | ||
<code bash> | <code bash> | ||
cd /opt/spark-2.2.0-bin-hadoop2.7/jars | cd /opt/spark-2.2.0-bin-hadoop2.7/jars | ||
- | zip /opt/spark-2.2.0-bin-hadoop2.7/spark220-jars.zip ./*</code> | + | zip /opt/spark-2.2.0-bin-hadoop2.7/spark220-jars.zip ./* |
- | + | # and then copy the archive to your HDFS | |
- | and then copy the archive to your HDFS | + | hdfs dfs -put /tmp/spark220-jars.zip /user/hdfs/</code> |
- | <code bash>hdfs dfs -put /tmp/spark220-jars.zip /user/hdfs/</code> | + | |