Support Questions
Find answers, ask questions, and share your expertise

Hue Sqoop Editor Application rejected by queue placement policy

New Contributor



I trying a simple sqoop import via the hue scoop 1 editor.image.png 


import \
  -Dmapreduce.job.queuename=my.queue \
  --as-avrodatafile \
  --username sqoop \
  --password-file file:///... \
  --connect "jdbc:mysql:/..." \
  --delete-target-dir \
  --target-dir /tmp/sqoop/import/_static_conversions \
  --split-by spot_date \
  --boundary-query "..." \
  --query "..." \
  --map-column-java  source=...

but unfortunatly it failed with.


Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1539009176224_25019 to YARN : Application rejected by queue placement policy
	at org.apache.hadoop.mapred.YARNRunner.submitJob(
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(
	at org.apache.hadoop.mapreduce.Job$
	at org.apache.hadoop.mapreduce.Job$
	at Method)
	at org.apache.hadoop.mapreduce.Job.submit(
	at org.apache.hadoop.mapred.JobClient$
	at org.apache.hadoop.mapred.JobClient$
	at Method)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(
	at org.apache.hadoop.mapred.JobClient.submitJob(
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(
	... 11 more

From the cli it works. Does someone know how to set the yarn jobqueue in the sqoop editor?


Thanks in advance.



Rising Star

Could you check if the submitted job is running on the queue which is specified in CLI.

1. Share the queue placement policy you have created.
2. Do you have yarn acl enabled ?


Expert Contributor



The probable reason for this job failure is that YARN is not allowing you to submit the job in this queue. Either this queue is not present over there or the placement rules are causing some issue.


There could be a scenario where this user has not been given the permission to submit the job in this queue.


1. Can you share the snapshot of the YARN dynamic resource pools that you have created.

2. Can you also share the snapshot of the YARN placement policies that you have set.

3. The username who is submitting the Sqoop job.

4. Kindly share the snapshot of the users you have given the access to this queue where you are submitting the job.


This will help us to check if there is some issue with the queue or permissions or placement policies.




Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.