Back
Can anyone tell me how to submit a Spark job on YARN?
"The following command template can be used to run JARs via the Spark framework:
./bin/spark-submit \ --class <main-class> \ --master <master-url> \ --deploy-mode <deploy-mode> \ --conf <key>=<value> \ ... # other options <application-jar> \ [application-arguments]"
./bin/spark-submit \
--class <main-class> \
--master <master-url> \
--deploy-mode <deploy-mode> \
--conf <key>=<value> \
... # other options
<application-jar> \
[application-arguments]"
If you are looking for an online course to learn Spark, I recommend this Spark Course by Intellipaat.
31k questions
32.8k answers
501 comments
693 users