User Tools

Site Tools


spark

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
spark [2019/02/27 10:56]
mantis [Providing spark jars]
spark [2019/02/27 10:56]
mantis [Providing spark jars]
Line 132: Line 132:
  
  
-add to spark-submit+Then you can make use of the provided archive by adding ​to spark-submit
  
 <​code> ​   --conf spark.yarn.archive=hdfs:///​user/​hdfs/​spark220-jars.zip </​code>​ <​code> ​   --conf spark.yarn.archive=hdfs:///​user/​hdfs/​spark220-jars.zip </​code>​
spark.txt ยท Last modified: 2020/05/12 14:26 by mantis