0 votes
1 view
in Big Data Hadoop & Spark by (11.5k points)

I built Spark 1.4 from the GH development master, and the build went through fine. But when I do a bin/pyspark I get the Python 2.7.9 version. How can I change this?

1 Answer

0 votes
by (31.4k points)
edited by

You need to set the environment variable first then execute /bin/pyspark.

  • export PYSPARK_PYTHON=python3
  • ./bin/pyspark  

If you want to know more about Spark, then do check out this awesome video tutorial:

Related questions

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
Welcome to Intellipaat Community. Get your technical queries answered by top developers !


Categories

...