as titled, how do I know which version of spark has been installed in the CentOS?
The current system has installed cdh5.1.0.
Open Spark shell Terminal and enter command
sc.version Or spark-submit --version
The easiest way is to just launch “spark-shell” in command line. It will display the
current active version of Spark.
You can get the spark version by using the following command:
spark-submit --versionspark-shell --versionspark-sql --version
Hope this answer helps you!
If you want more information regarding the same, refer the following video: