Created on 04-28-2014 06:35 AM - edited 09-16-2022 01:58 AM
Hi,
I configured using capacity scheduler and 3 queues with some ACLs on it.
Now I want to test the stuff by executing the "pi" M/R example provided by CDH.
How do I have to call it, to assign it to a specific queue ?
I tried: sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 20 20 -D mapreduce.job.queuename=lowprio
but this just prints out the usage hint:
""
Usage: org.apache.hadoop.examples.QuasiMonteCarlo <nMaps> <nSamples>
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|jobtracker:port> specify a job tracker
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.
The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]
""
thanks
Created 04-28-2014 06:48 AM
Hi,
some further googling enlightened me about the correct syntax 😉
for interested people the correct syntax is:
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100
Created 04-28-2014 06:48 AM
Hi,
some further googling enlightened me about the correct syntax 😉
for interested people the correct syntax is:
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100