You can't integrate Spark 2.0.0 with your current Installed Hadoop version.
If you will you go to Spark Download website, it will give you option for Spark with different version of Hadoop.
In your VM machine, you have Hadoop Version - Hadoop2.x --- CDH4
It means you must download Spark for CDH4 version which is available on Spark official website as Spark-1.6
You can follow the below link for spark 1.6 download If you want to integrate Spark with Hadoop
https://drive.google.com/drive/u/0/folders/1N8oZGL8fNMwd08mhd_hXwO9TaiZaRBcQ
Back