Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

How to submit a job to a specific queue???

avatar
Guru

Hi,

 

I configured using capacity scheduler and 3 queues with some ACLs on it.

Now I want to test the stuff by executing the "pi" M/R example provided by CDH.

 

How do I have to call it, to assign it to a specific queue ?

 

I tried: sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 20 20 -D mapreduce.job.queuename=lowprio

 

but this just prints out the usage hint:

""

Usage: org.apache.hadoop.examples.QuasiMonteCarlo <nMaps> <nSamples>
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|jobtracker:port> specify a job tracker
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.

The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]

""

 

thanks

1 ACCEPTED SOLUTION

avatar
Guru

Hi,

 

some further googling enlightened me about the correct syntax 😉

 

for interested people the correct syntax is:

hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100

View solution in original post

1 REPLY 1

avatar
Guru

Hi,

 

some further googling enlightened me about the correct syntax 😉

 

for interested people the correct syntax is:

hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100