Support Questions

Find answers, ask questions, and share your expertise

How to submit a job to a specific queue???

avatar
Guru

Hi,

 

I configured using capacity scheduler and 3 queues with some ACLs on it.

Now I want to test the stuff by executing the "pi" M/R example provided by CDH.

 

How do I have to call it, to assign it to a specific queue ?

 

I tried: sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 20 20 -D mapreduce.job.queuename=lowprio

 

but this just prints out the usage hint:

""

Usage: org.apache.hadoop.examples.QuasiMonteCarlo <nMaps> <nSamples>
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|jobtracker:port> specify a job tracker
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.

The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]

""

 

thanks

1 ACCEPTED SOLUTION

avatar
Guru

Hi,

 

some further googling enlightened me about the correct syntax 😉

 

for interested people the correct syntax is:

hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100

View solution in original post

1 REPLY 1

avatar
Guru

Hi,

 

some further googling enlightened me about the correct syntax 😉

 

for interested people the correct syntax is:

hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100