Member since
03-15-2018
7
Posts
1
Kudos Received
0
Solutions
03-28-2018
06:39 PM
and yes src/main/resources is also added to java build path. any help PLEASEEEEE!!!!!
... View more
03-28-2018
06:36 PM
Hi built a spark application which run alright on local mode but when I run on hortonworks sandbox it throws back the error message at the bottom - I included the dependencies in my build.sbt file. - imported typesafe on my application => import com.typesafe.config._ package retail import org.apache.spark.SparkContext, org.apache.spark.SparkConf
import com.typesafe.config._ import org.apache.hadoop.fs._
object AvgRevenueDaily {
def main (args: Array[String]){
val appConf = ConfigFactory.load()
val conf = new SparkConf().
setAppName("Average Revenue - Daily").
setMaster(appConf.getConfig(args(2)).getString("deploymentMaster"))
val sc = new SparkContext(conf)
val inputPath = args(0)
val outputPath = args(1) Exception in thread "main" java.lang.NoClassDefFoundError: com/typesafe/config/ConfigFactory
at retail.AvgRevenueDaily$.main(AvgRevenueDaily.scala:11)
at retail.AvgRevenueDaily.main(AvgRevenueDaily.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$runMain(SparkSubmit.scala:782)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: com.typesafe.config.ConfigFactory
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 11 more
... View more
Labels:
- Labels:
-
Apache Spark
03-20-2018
02:30 PM
HI @Scott Shaw Communication with the Hortonworks training/support team could really be frustrating sometimes. I have issues purchasing a new HDPCD exam. The exam is still marked as registered even after I have taken the exam, which makes it impossible for me purchase a new exam and retake it. Despite the fact hat I have sent numerous emails, I havent even recieved a reply stating that they recieved my email. I started with so much enthusiasm with Hortonworks and despite the fact that my company partners with hortonworks, I have had very terible experiences with them. From the exam environment to the constant delay in replies etc. I reall need to reprogram this certification. As I mentioned in earlier posts my job depends heavily on this. All I need is for the HDPCD certification to be activated within my profile so I can do a new purchase and retake the exam. I will very much appreciate if you could be of help with this. Thank you
... View more
03-15-2018
01:28 PM
I am addressing this to the certification team. I find it quite disturbing that after 5 days and several mails to the certification team, I still have not received the results of my exam. I even filed a complaints about the environment and no one hast bothered to contact me. I am quite sure you will understnad that I need these information to be able to plan my next steps. For a big and well know organisation I think Hortonworks does not handle these isues quite well. I therefore hope that someone will react to my emails so I know what to do next. My job depends on this and I am sure you understand that.
... View more
- Tags:
- Hadoop Core
- hdpcd
03-15-2018
09:11 AM
1 Kudo
@Abhijnan Kundu select count(airport_id) as airportcount, country from airports group by country order by airportcount desc Limit 1;
... View more