Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 12-18-2015 10:21 PM
in the sandbox tutorial Lab-4 on Spark, when running this statement:
risk_factor_spark.saveAsOrcFile("risk_factor_spark")
it gives me the following error:
error: value saveAsOrcFile is not a member of org.apache.spark.sql.DataFrame
I have done the 'import org.apache.spark.sql.hive.orc._' earlier in the lab. Also tried capital '..ORC..'. And I am using the built-in web client for the SSH client.
Any suggestions?
Created 12-21-2015 05:37 AM
. @David Andreae If you are using Spark >= 1.4 try the following command
risk_factor_spark.write.format("orc").save("risk_factor_spark")
Created 12-21-2015 05:37 AM
. @David Andreae If you are using Spark >= 1.4 try the following command
risk_factor_spark.write.format("orc").save("risk_factor_spark")
Created 01-27-2016 04:10 PM
This helped me - thank you.
Created 12-21-2015 05:41 AM
what spark version is this?