Explore Courses Blog Tutorials Interview Questions
0 votes
in Big Data Hadoop & Spark by (6.5k points)

Can anyone tell me how to install Spark on Ubuntu 16.04?

1 Answer

0 votes
by (11.3k points)

Apache Spark can be installed on Ubuntu by following the below steps:

  • Download the latest stable version of Apache Spark
  • Unpack the compressed archive:

$ tar -xvf spark-2.1.1-bin-hadoop2.7.tgz

  • Rename the resulting folder with a shorter name and move it to another directory:

$ sudo mv spark-2.1.1-bin-hadoop2.7 /usr/local/

$ sudo ln -s /usr/local/spark-2.1.1-bin-hadoop2.7/ /usr/local/spark

$ cd /usr/local/spark

  • Export the SPARK_HOME variable:

$ export SPARK_HOME=/usr/local/spark

  • Start a standalone master server:

$ $SPARK_HOME/sbin/

  • Start a standalone worker process:

$ $SPARK_HOME/sbin/ spark://ethane:7077

  • Start the spark-shell:

$ spark-shell"

If you are looking for an online course to learn SparkI recommend this Apache Spark Certification program by Intellipaat.

Related questions

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

Browse Categories