Created 06-02-2016 12:22 PM
clusterurl.pnglogurlpng.pngterminal.pngI am using Sandbox 2.4 , I created a simple Spark Java application with the following conif.
SparkConf conf = new SparkConf().setAppName("spark").set("spark.master", "yarn-client");
I packaged a Jar and used spark-submit to run the app
but I got the following error.
Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
I opened the URL
http://localhost:8088/cluster/app/application_1464857740650_0009
and clicked on the log link to see the log, but I got
Access Denied.
I attached couple of photos to give a clear idea what's going on with me
thank you for your help.
Created 06-02-2016 12:38 PM
it looks you have not enough resources available with RM and also you are not able to check resource available due to access denied on RM UI.try to access ui by replacing http://sandbox.hortonworks.com:8042 by http://<IP_OF_SANDBOX>:8042 and ensure that your IP is reachable from your host
as this is a single node so you can try yarn node -status <nm ip>
Created 06-02-2016 12:56 PM
thank you for your answer,
when I do
yarn node -status 10.24.245.96:8042
[root@sandbox bin]# yarn node -status 10.24.245.96:8042 16/06/02 12:54:41 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 16/06/02 12:54:41 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.24.245.96:8050 Could not find the node report for node id : 10.24.245.96:8042
and I can access
see the photo please .nodemanager.png
Created 06-02-2016 01:13 PM
and can you please tell my why I am getting access denied on RM UI?
Created 06-02-2016 01:25 PM
is anything else running in the spark cluster (like Zeppelin)?
Or do you have not enough YARN resources?
Created 06-02-2016 01:28 PM
I didn't run anything except this spark application.
I installed sandbox 2.4 on VirtualBox on windows machine, and I gave this VM 2 cores and 8GB.
Created 06-02-2016 01:34 PM
can you screen print the main screen of ambari. make sure you are running the spark job from the command line on the sandbox
Created 06-02-2016 01:42 PM
yes I'm running it from command line on the sandbox,
and here is the screen shot of Ambari ambariscreen.png
Created 06-02-2016 01:47 PM
what does it saw on the main page for YARN resources?
Created 06-02-2016 01:49 PM
@Timothy Spannrm-ui.pngyarnservice.png
I attatched photos for Yarn Service page and RM UI page.