Support Questions

Find answers, ask questions, and share your expertise

Unable to submit job using yarn rest api


I am able to submit job through the terminal and if I am using the same command and submit the job through the yarn rest api it not submitting and one more thing is even I specified the queue as 'a'  but it is taking queue as default. As I am just beginner I am not able encounter the problem can anyone help getting out of this please . THANKS IN ADVANCE  



'application-id': 'application_1675072653900_0123',
'application-name': None,
'am-container-spec': {
'commands': {
'command': '/home/kirankathe/Desktop/spark-3.3.1-bin-hadoop3/bin/spark-submit --master yarn --deploy-mode client --packages org.mongodb.spark:mongo-spark-connector_2.12:3.0.1 --driver-memory 1g --executor-memory 1g --num-executors 1 --executor-cores 2 --queue a --class org.apache.spark.examples.SparkPi hdfs://localhost:9000/user/kirankathe/'
'local-resources': {
'entry': [{
'key': '',
'value': {
'resource': 'hdfs://localhost:9000/user/kirankathe/',
'type': 'FILE',
'visibility': 'APPLICATION',
'timestamp': 1675259542629
'application-type': 'SPARK',
'priority': 0,
'max-app-attempts': 1


Cloudera Employee

It is worth looking at the application logs here and checking user permissions for your queue here