Back

Explore Courses Blog Tutorials Interview Questions

Connection b/w my Spark Application and HDFS

0 votes
2 views
in Big Data Hadoop & Spark by (45.3k points)
I am not able to connect my Spark Application to HDFS

1 Answer

0 votes
by (16.8k points)

You can't integrate Spark 2.0.0 with your current Installed Hadoop version.

If you will you go to Spark Download website, it will give you option for Spark with different version of Hadoop.

In your VM machine, you have Hadoop Version - Hadoop2.x --- CDH4

It means you must download Spark for CDH4 version which is available on Spark official website as Spark-1.6

You can follow the below link for spark 1.6 download If you want to integrate Spark with Hadoop

https://drive.google.com/drive/u/0/folders/1N8oZGL8fNMwd08mhd_hXwO9TaiZaRBcQ

Related questions

0 votes
1 answer
Hive Access Denied issue
asked Jul 10, 2019 in Big Data Hadoop & Spark by Eresh Kumar (45.3k points)

Browse Categories

© COPYRIGHT 2011-2023 INTELLIPAAT.COM. ALL RIGHTS RESERVED.

Download Salary Trends Now !

Learn how professionals like you got up to 100% Salary Hike.

...