Member since
06-01-2016
15
Posts
1
Kudos Received
0
Solutions
06-02-2016
02:11 PM
@Timothy Spann Can you please explain to me what the following line mean sparkConf.set("spark.serializer", classOf[KryoSerializer].getName)
... View more
06-02-2016
01:57 PM
@Jitendra Yadav I just need to know why when I opened the URL
http://localhost:8088/cluster/app/application_1464857740650_0009 and clicked on the log link to see the log, I got Access Denied. please see the attached photo clusterurl.pnglogurlpng.png thank you.
... View more
06-02-2016
01:52 PM
@Timothy Spann I tried different command to submit the job spark-submit --class com.Spark.MainClass /home/Test-0.0.1-SNAPSHOT.jar and spark-submit --class com.Spark.MainClass -master yarn-client /home/Test-0.0.1-SNAPSHOT.jar
... View more
06-02-2016
01:49 PM
@Timothy Spannrm-ui.pngyarnservice.png I attatched photos for Yarn Service page and RM UI page.
... View more
06-02-2016
01:42 PM
@Timothy Spann yes I'm running it from command line on the sandbox, and here is the screen shot of Ambari ambariscreen.png
... View more
06-02-2016
01:28 PM
@Timothy Spann I didn't run anything except this spark application. I installed sandbox 2.4 on VirtualBox on windows machine, and I gave this VM 2 cores and 8GB.
... View more
06-02-2016
01:13 PM
@Rajkumar Singh and can you please tell my why I am getting access denied on RM UI?
... View more
06-02-2016
12:56 PM
@Rajkumar Singh thank you for your answer, when I do yarn node -status 10.24.245.96:8042 [root@sandbox bin]# yarn node -status 10.24.245.96:8042
16/06/02 12:54:41 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
16/06/02 12:54:41 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.24.245.96:8050
Could not find the node report for node id : 10.24.245.96:8042 and I can access http://10.24.245.96:8042/node see the photo please .nodemanager.png
... View more
06-02-2016
12:22 PM
1 Kudo
clusterurl.pnglogurlpng.pngterminal.pngI am using Sandbox 2.4 , I created a simple Spark Java application with the following conif. SparkConf conf = new SparkConf().setAppName("spark").set("spark.master", "yarn-client"); I packaged a Jar and used spark-submit to run the app but I got the following error. Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources I opened the URL http://localhost:8088/cluster/app/application_1464857740650_0009 and clicked on the log link to see the log, but I got Access Denied. I attached couple of photos to give a clear idea what's going on with me thank you for your help.
... View more
Labels: