Intellipaat Back

Explore Courses Blog Tutorials Interview Questions
0 votes
4 views
in Big Data Hadoop & Spark by (6.5k points)

Can anyone tell me how to submit a Spark job on YARN?

1 Answer

0 votes
by (11.3k points)

"The following command template can be used to run JARs via the Spark framework:

./bin/spark-submit \

  --class <main-class> \

  --master <master-url> \

  --deploy-mode <deploy-mode> \

  --conf <key>=<value> \

  ... # other options

  <application-jar> \

  [application-arguments]"

If you are looking for an online course to learn Spark, I recommend this Spark Course by Intellipaat.

31k questions

32.8k answers

501 comments

693 users

Browse Categories

...