While saving a data frame in ORC format, i am getting below mentioned exception in my logs.
java.lang.AssertionError: assertion failed: The ORC data source can only be used with HiveContext I tried below mentioned alternatives but none of them worked.
sampleData.write().mode(SaveMode.Append).format("orc").save("/tmp/my_orc");
sampleData.write().mode(SaveMode.Append).saveAsTable("MFRTable")
I am using Spark 1.6.1.2.4.2.12-1, and has below mentioned dependency added in my project <dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-sql_2.10</artifactId>
<version>1.6.1.2.4.2.12-1</version>
<scope>provided</scope>
</dependency> but then i am not able to find HiveContext object. Wondering which version should i be using ? Thanks.
... View more
