question Re: getting error while persisting spark output to hive in Archives of Support Questions (Read Only)

getting error while persisting spark output to hive

DivyaGehlot13 — Wed, 09 Dec 2015 17:38:24 GMT

scala> df.select("name","age").write().format("com.databricks.spark.csv").mode(SaveMode.Append).saveAsTable("PersonHiveTable");
<console>:39: error: org.apache.spark.sql.DataFrameWriter does not take parameters

Re: getting error while persisting spark output to hive

amcbarnett — Thu, 10 Dec 2015 12:31:12 GMT

@Divya Gehlot

Since this is scala and not Java, the following should work

df.select("name","age").write.format("com.databricks.spark.csv").mode(SaveMode.Append).saveAsTable("PersonHiveTable");