Hue Sqoop Editor Application rejected by queue placement policy

[#1]

Hey,

I trying a simple sqoop import via the hue scoop 1 editor. 

import \
  -Dmapreduce.job.queuename=my.queue \
  --as-avrodatafile \
  --username sqoop \
  --password-file file:///... \
  --connect "jdbc:mysql:/..." \
  --delete-target-dir \
  --target-dir /tmp/sqoop/import/_static_conversions \
  --split-by spot_date \
  --boundary-query "..." \
  --query "..." \
  --map-column-java  source=...

but unfortunatly it failed with.

Caused by: java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1539009176224_25019 to YARN : Application rejected by queue placement policy
	at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:336)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1231)
	... 11 more

From the cli it works. Does someone know how to set the yarn jobqueue in the sqoop editor?

Thanks in advance.

[#2]

Hi,

Could you check if the submitted job is running on the queue which is specified in CLI.

1. Share the queue placement policy you have created.
2. Do you have yarn acl enabled ?

Thanks
Jerry

[#3]

Hi,

The probable reason for this job failure is that YARN is not allowing you to submit the job in this queue. Either this queue is not present over there or the placement rules are causing some issue.

There could be a scenario where this user has not been given the permission to submit the job in this queue.

1. Can you share the snapshot of the YARN dynamic resource pools that you have created.

2. Can you also share the snapshot of the YARN placement policies that you have set.

3. The username who is submitting the Sqoop job.

4. Kindly share the snapshot of the users you have given the access to this queue where you are submitting the job.

This will help us to check if there is some issue with the queue or permissions or placement policies.

Regards

Nitish