Intellipaat Back

Explore Courses Blog Tutorials Interview Questions

How to check the Spark version in PySpark?

0 votes
2 views
in Big Data Hadoop & Spark by (6.5k points)

Can anyone tell me how to check the Spark version in PySpark?

1 Answer

0 votes
by (11.3k points)

You can simply write the following command to know the current Spark version in PySpark, assuming the Spark Context variable to be 'sc':

sc.version

If you are looking for an online course to learn Spark, I recommend this Spark Course by Intellipaat.

Related questions

+1 vote
3 answers
How to check the Spark version
asked Jul 2, 2019 in Big Data Hadoop & Spark by tommas (1k points)

31k questions

32.8k answers

501 comments

693 users

Browse Categories

© COPYRIGHT 2011-2024 INTELLIPAAT.COM. ALL RIGHTS RESERVED.

...