User Tools

Site Tools


spark

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
spark [2019/02/27 10:56]
mantis [Providing spark jars]
spark [2019/06/24 16:45]
mantis
Line 1: Line 1:
 Unless noted otherwise, code is tested with Spark **2.2** Unless noted otherwise, code is tested with Spark **2.2**
 +
 +====== Non-committal testdrive ======
 +
 +Minimum-effort way to test-drive Spark with a 
 +[[https://​databricks.com/​spark/​getting-started-with-apache-spark/​quick-start#​overview|Databricks tutorial]] (no local setup required)
  
  
Line 132: Line 137:
  
  
-add to spark-submit+Then you can make use of the provided archive by adding ​to spark-submit
  
 <​code> ​   --conf spark.yarn.archive=hdfs:///​user/​hdfs/​spark220-jars.zip </​code>​ <​code> ​   --conf spark.yarn.archive=hdfs:///​user/​hdfs/​spark220-jars.zip </​code>​
Line 144: Line 149:
  
  
 +====== Tuning ======
  
spark.txt ยท Last modified: 2020/05/12 14:26 by mantis