04-03-2014 02:44 AM - edited 04-03-2014 03:49 AM
I have cloudera VM cdh4.4.0.
I am able to submit jobs with the yarn command but not with as a Java application.
The issue i faced is by default the yarn.application.classpath is set as
$HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HADOOP_COMMON_HOME/share/hadoop/common/lib/*, $HADOOP_HDFS_HOME/share/hadoop/hdfs/*, $HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*, $HADOOP_YARN_HOME/share/hadoop/yarn/*, $HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
but with this classpath , after i submitted my job the container fails to start without any message e.g. classnotfounderror, it just silently fails and remove all the container logs with it.
By setting the yarn.application.classpath from yarn-site.xml from hadoop-yarn configuration it works.
Can you tell me what is the best way to set this classpath and if cloudera installation should create links so that the default classpath works?
04-03-2014 10:44 AM