Support Questions
Find answers, ask questions, and share your expertise

%spark2 is not available in Azure Sandbox for HDP

%spark2 is not available in Azure Sandbox for HDP

New Contributor

I am in Azure - HDP Sandbox. I am in the following step in the tutorial. "SparkSession" is not there as Zeppelin is pointing to spark and not spark2. Will appreciate any help from the community to solve this issue. Thanks.

%spark2
valhiveContext=neworg.apache.spark.sql.SparkSession.Builder().getOrCreate()
2 REPLIES 2

Re: %spark2 is not available in Azure Sandbox for HDP

Super Collaborator

do you get an error message?

Re: %spark2 is not available in Azure Sandbox for HDP

@Krishnaswami Rajagopalan,

What is the HDP version that you are using ? Is it HDP 2.5 . If yes, spark2 is not supported by default. I have provided some links to configure spark2 in HDP 2.5. Else you can use HDP 2.6

https://community.hortonworks.com/questions/150032/spark2-interpreter-not-found-in-zeppelin-ui-using...

Thanks,

Aditya