Spark hive integration

Question

Is there any code for the Spark Integration?

Answer 1

Try this: 

spark-shell

import org.apache.spark.sql.hive.HiveContext

val sqlContext = new HiveContext(sc)

val customers = sqlContext.sql("select * from retail.customer")

customers.collect.foreach(println);

customers.registerTempTable("customer");

val topprof = spark.sql("select profession, count(*) as headcount from

customer group by profession order by headcount desc LIMIT 5")

topprof.show()