Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hue Sqoop Editor Application rejected by queue placement policy

Hue Sqoop Editor Application rejected by queue placement policy

New Contributor

Hey,

 

I trying a simple sqoop import via the hue scoop 1 editor.image.png 

 

import \
  -Dmapreduce.job.queuename=my.queue \
  --as-avrodatafile \
  --username sqoop \
  --password-file file:///... \
  --connect "jdbc:mysql:/..." \
  --delete-target-dir \
  --target-dir /tmp/sqoop/import/_static_conversions \
  --split-by spot_date \
  --boundary-query "..." \
  --query "..." \
  --map-column-java  source=...

but unfortunatly it failed with.

 

Caused by: java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1539009176224_25019 to YARN : Application rejected by queue placement policy
	at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:336)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1231)
	... 11 more

From the cli it works. Does someone know how to set the yarn jobqueue in the sqoop editor?

 

Thanks in advance.

 

2 REPLIES 2

Re: Hue Sqoop Editor Application rejected by queue placement policy

Rising Star
Hi,

Could you check if the submitted job is running on the queue which is specified in CLI.

1. Share the queue placement policy you have created.
2. Do you have yarn acl enabled ?

Thanks
Jerry

Re: Hue Sqoop Editor Application rejected by queue placement policy

Rising Star

Hi,

 

The probable reason for this job failure is that YARN is not allowing you to submit the job in this queue. Either this queue is not present over there or the placement rules are causing some issue.

 

There could be a scenario where this user has not been given the permission to submit the job in this queue.

 

1. Can you share the snapshot of the YARN dynamic resource pools that you have created.

2. Can you also share the snapshot of the YARN placement policies that you have set.

3. The username who is submitting the Sqoop job.

4. Kindly share the snapshot of the users you have given the access to this queue where you are submitting the job.

 

This will help us to check if there is some issue with the queue or permissions or placement policies.

 

Regards

Nitish