Member since
12-06-2018
1
Post
0
Kudos Received
0
Solutions
12-06-2018
04:01 AM
Hey,
I trying a simple sqoop import via the hue scoop 1 editor.
import \
-Dmapreduce.job.queuename=my.queue \
--as-avrodatafile \
--username sqoop \
--password-file file:///... \
--connect "jdbc:mysql:/..." \
--delete-target-dir \
--target-dir /tmp/sqoop/import/_static_conversions \
--split-by spot_date \
--boundary-query "..." \
--query "..." \
--map-column-java source=...
but unfortunatly it failed with.
Caused by: java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1539009176224_25019 to YARN : Application rejected by queue placement policy
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:336)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1231)
... 11 more
From the cli it works. Does someone know how to set the yarn jobqueue in the sqoop editor?
Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Sqoop
-
Apache YARN
-
Cloudera Hue