Support Questions
Find answers, ask questions, and share your expertise

Unable to compile Maven Spark in Eclipse using hiveContext.read.format("com.databricks.spark.xml") ---->> "read" on HContext is deprecated

New Contributor

I am ingesting a lot of XML data into Hive using Spark XML jar -->> "spark-xml_2.10-0.3.3.jar". My following "read" works fin ein spark-shell but fails in a Maven compile...

hiveContext.read.format("com.databricks.spark.xml").option("rowTag", rootNode).option("attributePrefix", "CF_").option("valueTag", "VALUE").load(fileWithPathName )

This is VERY VERY vital and useful for us going forward!!! Any assistance appreciated!!

Thanks!

3 REPLIES 3

New Contributor

In other words the code works fine in spark-shell but does not compile under Maven...

Contributor

unable to build as JAR ?

New Contributor

Hi, is it because of using deprecated API but Eclipse itself doesn't allow deprecated usage?