Explore Courses Blog Tutorials Interview Questions
0 votes
1 view
in Big Data Hadoop & Spark by (11.4k points)

I'm trying to get the path to spark.worker.dir for the current sparkcontext.

1 Answer

0 votes
by (32.3k points)

Yes, I would suggest you to try the method below in order to get the current spark context settings.


as accessed by

Another method specifically for Spark 2.1+


where spark is your sparksession (gives you a dict with all configured settings)

Welcome to Intellipaat Community. Get your technical queries answered by top developers!

28.4k questions

29.7k answers


94.1k users

Browse Categories