Back

Explore Courses Blog Tutorials Interview Questions

How to check the Spark version in PySpark?

0 votes
2 views
in Big Data Hadoop & Spark by (6.5k points)

Can anyone tell me how to check the Spark version in PySpark?

1 Answer

0 votes
by (11.3k points)

You can simply write the following command to know the current Spark version in PySpark, assuming the Spark Context variable to be 'sc':

sc.version

If you are looking for an online course to learn Spark, I recommend this Spark Course by Intellipaat.

Related questions

0 votes
1 answer
How to check the Spark version?
asked Jul 9, 2020 in Big Data Hadoop & Spark by angadmishra (6.5k points)
+1 vote
2 answers
How to check the Spark version
asked Jul 2, 2019 in Big Data Hadoop & Spark by tommas (1k points)

Browse Categories

© COPYRIGHT 2011-2023 INTELLIPAAT.COM. ALL RIGHTS RESERVED.

Download Salary Trends Now !

Learn how professionals like you got up to 100% Salary Hike.

...