Back
as titled, how do I know which version of spark has been installed in the CentOS?
The current system has installed cdh5.1.0.
Open Spark shell Terminal and enter command
sc.version Or spark-submit --version
The easiest way is to just launch “spark-shell” in command line. It will display the
current active version of Spark.
You can get the spark version by using the following command:
spark-submit --versionspark-shell --versionspark-sql --version
spark-submit --version
spark-shell --version
spark-sql --version
Hope this answer helps you!
If you want more information regarding the same, refer the following video:
1.Using Command Line
2.Using PySpark and In Spark shell
i. Import pyspark
print(pyspark.__version__)
ii. Sc.version
31k questions
32.8k answers
501 comments
693 users