Created 08-15-2016 09:06 AM
thanks Arun for your response.
I have tried in scala IDE by creating maven project and when ever I am adding dependency of spark getting compile time error for which I couldn't proceed. I am using HDP 2.4 which has spark 1.6.0 and scala 2.10.5.
I am not sure which scala IDE and what versions I have to use. please suggest me. I just want to build a jar and submit the job.
Have not tried out muck with maven for spark, but I have a sample here. You can checkout the same project (POM) and add the necessary hive dependancy and add your code. https://github.com/ak-arun/spark/tree/master/spark-java-rdd-dataframe