SparkConf conf = new SparkConf().setAppName("spark").set("spark.master", "yarn-client");
I packaged a Jar and used spark-submit to run the app
but I got the following error.
Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
I opened the URL
and clicked on the log link to see the log, but I got
I attached couple of photos to give a clear idea what's going on with me
thank you for your help.
it looks you have not enough resources available with RM and also you are not able to check resource available due to access denied on RM UI.try to access ui by replacing http://sandbox.hortonworks.com:8042 by http://<IP_OF_SANDBOX>:8042 and ensure that your IP is reachable from your host
as this is a single node so you can try yarn node -status <nm ip>
thank you for your answer,
when I do
yarn node -status 10.24.245.96:8042
[root@sandbox bin]# yarn node -status 10.24.245.96:8042 16/06/02 12:54:41 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 16/06/02 12:54:41 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.24.245.96:8050 Could not find the node report for node id : 10.24.245.96:8042
and I can access
see the photo please .nodemanager.png
is anything else running in the spark cluster (like Zeppelin)?
Or do you have not enough YARN resources?
can you screen print the main screen of ambari. make sure you are running the spark job from the command line on the sandbox