https://community.cloudera.com/t5/Support-Questions/How-to-save-a-dataframe-as-ORC-file/m-p/144703#M107282 <P>Create some properties in your pom.xml:</P><PRE>&lt;properties&gt; &lt;project.build.sourceEncoding&gt;UTF-8&lt;/project.build.sourceEncoding&gt; &lt;scala.core&gt;2.10&lt;/scala.core&gt; &lt;spark.version&gt;1.6.1&lt;/spark.version&gt; &lt;/properties&gt; </PRE><P>Include spark-hive in your project's dependencies:</P><PRE>&lt;dependency&gt; &lt;groupId&gt;org.apache.spark&lt;/groupId&gt; &lt;artifactId&gt;spark-hive_${scala.core}&lt;/artifactId&gt; &lt;version&gt;${spark.version}&lt;/version&gt; &lt;/dependency&gt; </PRE><P>Then in your code:</P><PRE>// create a new hive context from the spark context val hiveContext = new org.apache.spark.sql.hive.HiveContext(sparkContext) // create the data frame and write it to orc // output will be a directory of orc files val df = hiveContext.createDataFrame(rdd) df.write.mode(SaveMode.Overwrite).format("orc") .save("/tmp/myapp.orc/") </PRE> Sat, 10 Dec 2016 06:18:11 GMT christopher_w_m 2016-12-10T06:18:11Z