How to submit a job to a specific queue???

geko — Fri, 16 Sep 2022 08:58:02 GMT

Hi,

I configured using capacity scheduler and 3 queues with some ACLs on it.

Now I want to test the stuff by executing the "pi" M/R example provided by CDH.

How do I have to call it, to assign it to a specific queue ?

I tried: sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 20 20 -D mapreduce.job.queuename=lowprio

but this just prints out the usage hint:

Usage: org.apache.hadoop.examples.QuasiMonteCarlo <nMaps> <nSamples>
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|jobtracker:port> specify a job tracker
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.

The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]

thanks

Re: How to submit a job to a specific queue???

geko — Mon, 28 Apr 2014 13:48:46 GMT

Hi,

some further googling enlightened me about the correct syntax 😉

for interested people the correct syntax is:

hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100

question Re: How to submit a job to a specific queue??? in Archives of Support Questions (Read Only)

How to submit a job to a specific queue???

Re: How to submit a job to a specific queue???