Expert Contributor
Posts: 131
Registered: ‎08-08-2013
Accepted Solution

How to submit a job to a specific queue???



I configured using capacity scheduler and 3 queues with some ACLs on it.

Now I want to test the stuff by executing the "pi" M/R example provided by CDH.


How do I have to call it, to assign it to a specific queue ?


I tried: sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 20 20 -D mapreduce.job.queuename=lowprio


but this just prints out the usage hint:


Usage: org.apache.hadoop.examples.QuasiMonteCarlo <nMaps> <nSamples>
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|jobtracker:port> specify a job tracker
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.

The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]




Expert Contributor
Posts: 131
Registered: ‎08-08-2013

Re: How to submit a job to a specific queue???



some further googling enlightened me about the correct syntax ;)


for interested people the correct syntax is:

hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100