Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Unable to save data from Spark into Hive

avatar
Expert Contributor

Hi,

Trying to complete Lab 4 (Riskfactor Analysis with Spark), i got the following error for the last instruction:

%spark hiveContext.sql("create table riskfactor as select * from finalresults")

<console>:28: error: not found: value hiveContext

hiveContext.sql("create table riskfactor as select * from finalresults")

^

Any idea please?

Regards,

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Did u run the import and initialization of hive context like below ?

import org.apache.spark.sql.hive.orc._
import org.apache.spark.sql._

val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)

If you still face issues, check if hive is running.

View solution in original post

2 REPLIES 2

avatar
Expert Contributor

Did u run the import and initialization of hive context like below ?

import org.apache.spark.sql.hive.orc._
import org.apache.spark.sql._

val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)

If you still face issues, check if hive is running.

avatar
Expert Contributor

Now it works fine thank you.