question Re: issue while inserting data into hive through spark in Archives of Support Questions (Read Only)

issue while inserting data into hive through spark

prsingh1 — Wed, 22 Mar 2017 13:21:34 GMT

Not able to insert data into hive table through spark

scala> sqlContext.sql("insert into table results_test_hive values('XXXXXXXXXX', 'm:X', 0.0)")

Failed with below error,

org.apache.spark.sql.AnalysisException:

Unsupported language features in query: insert into table results_test_hive values('XXXXXXXXXX', 'm:X', 0.0)

Re: issue while inserting data into hive through spark

nyadav — Wed, 22 Mar 2017 13:23:37 GMT

Hi @prsingh, Spark currently doesn't support "insert into feature", you may create dataframe and append to the table.

scala> var data = sqlContext.createDataFrame(Seq(("ZZ", "m:x", 34.0))).toDF("pv", "metric", "value") 
scala> data.show() 
scala> data.write.mode("append").saveAsTable("results_test_hive") 
scala> println(sqlContext.sql("select * from results_test_hive").count())

Re: issue while inserting data into hive through spark

prsingh1 — Wed, 22 Mar 2017 19:17:28 GMT

@nyadav

Thanks for the information . I was able to insert after creating the dataframe.