Created 12-18-2015 10:21 PM
in the sandbox tutorial Lab-4 on Spark, when running this statement:
risk_factor_spark.saveAsOrcFile("risk_factor_spark")
it gives me the following error:
error: value saveAsOrcFile is not a member of org.apache.spark.sql.DataFrame
I have done the 'import org.apache.spark.sql.hive.orc._' earlier in the lab. Also tried capital '..ORC..'. And I am using the built-in web client for the SSH client.
Any suggestions?
Created 12-21-2015 05:37 AM
. @David Andreae If you are using Spark >= 1.4 try the following command
risk_factor_spark.write.format("orc").save("risk_factor_spark")
Created 12-21-2015 05:37 AM
. @David Andreae If you are using Spark >= 1.4 try the following command
risk_factor_spark.write.format("orc").save("risk_factor_spark")
Created 01-27-2016 04:10 PM
This helped me - thank you.
Created 12-21-2015 05:41 AM
what spark version is this?