This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
spark [2019/02/27 10:56] mantis [Providing spark jars] |
spark [2019/04/24 12:55] mantis |
||
---|---|---|---|
Line 1: | Line 1: | ||
Unless noted otherwise, code is tested with Spark **2.2** | Unless noted otherwise, code is tested with Spark **2.2** | ||
+ | |||
+ | ====== Non-committal testdrive ====== | ||
+ | |||
+ | Minimum-effort way to test-drive Spark with a | ||
+ | [[https://databricks.com/spark/getting-started-with-apache-spark/quick-start#overview|Databricks tutorial]] (no local setup required) | ||
Line 132: | Line 137: | ||
- | add to spark-submit | + | Then you can make use of the provided archive by adding to spark-submit |
<code> --conf spark.yarn.archive=hdfs:///user/hdfs/spark220-jars.zip </code> | <code> --conf spark.yarn.archive=hdfs:///user/hdfs/spark220-jars.zip </code> |