Support Questions
Find answers, ask questions, and share your expertise

Unable to save data from Spark into Hive

Rising Star

Hi,

Trying to complete Lab 4 (Riskfactor Analysis with Spark), i got the following error for the last instruction:

%spark hiveContext.sql("create table riskfactor as select * from finalresults")

<console>:28: error: not found: value hiveContext

hiveContext.sql("create table riskfactor as select * from finalresults")

^

Any idea please?

Regards,

1 ACCEPTED SOLUTION

Rising Star

Did u run the import and initialization of hive context like below ?

import org.apache.spark.sql.hive.orc._
import org.apache.spark.sql._

val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)

If you still face issues, check if hive is running.

View solution in original post

2 REPLIES 2

Rising Star

Did u run the import and initialization of hive context like below ?

import org.apache.spark.sql.hive.orc._
import org.apache.spark.sql._

val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)

If you still face issues, check if hive is running.

Rising Star

Now it works fine thank you.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.