Support Questions

Find answers, ask questions, and share your expertise

modify classpath in mapreduce jobs (oozie, scalding and parquet in CDH-5.0.1-1.cdh5.0.1.p0.47)

avatar
Explorer

I have a question about classpath in map reduce jobs (CDH5 yarn): 

Is it’s possible to exclude a jar file from a map reduce job’s classpath? 
or maybe exclude all files that come from /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop ? 
or maybe exclude system classloader (not sure this is correct name) so only classes from my uber jar file are used? 

We use parquet 1.5 in our scalding map reduce jobs in CDH-5.0.1-1.cdh5.0.1.p0.47 and found that sometimes parquet.hadoop.ParquetFileReader.runAllInParallel is blocked for several hours in oozie java launcher map reduce job. Killing a job and re-running usually fixes the issue. We’d like to find the cause. 

When we run our scalding jobs from oozie java action here is the classpath printed to stdout logs (see bellow). We are not sure what version of parquet jar files comes with CDH-5.0.1-1.cdh5.0.1.p0.47. By looking into github.com/cloudera/parquet-mr branches looks like it's < 1.5 

So we think that maybe /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop contains older version of parquet library (< 1.5) and by excluding it from the classpath we could get rid of the blocked jobs. 

The java action in oozie workflow.xml file that runs scalding jobs (where scalding_jar is uberjar that includes all classes used by that scalding job including parquet classes): 

<action name="report"> 
<java> 
<job-tracker>${jobTracker}</job-tracker> 
<name-node>${nameNode}</name-node> 

<prepare> 
<delete path="${outputScalding}"/> 
</prepare> 

<main-class>com.twitter.scalding.Tool</main-class> 
<java-opts>-Xms512m</java-opts> 

<arg>-Dmapreduce.job.reduces=${numReduceTasks}</arg> 
<arg>-Dmapreduce.job.queuename=${pool}</arg> 

<arg>-Dmapreduce.map.output.compress=true</arg> 
<arg>-Dmapreduce.output.fileoutputformat.compress=true</arg> 
<arg>-Dmapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec</arg> 
<arg>-Dmapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.SnappyCodec</arg> 

<arg>${scalding_job}</arg> 

<arg>--hdfs</arg> 

<arg>--${prop1_name}</arg> 
<arg>${prop1_value}</arg> 

<arg>--${prop2_name}</arg> 
<arg>${prop2_value}</arg> 

<arg>--${prop3_name}</arg> 
<arg>${prop3_value}</arg> 

<arg>--${input1_name}</arg> 
<arg>${input1_value}</arg> 

<arg>--${input2_name}</arg> 
<arg>${input2_value}</arg> 

<arg>--output</arg> 
<arg>${outputScalding}</arg> 

<file>${scalding_jar}</file> 
</java> 

<ok to="decision-export"/> 
<error to="kill"/> 
</action>

 

Snippet of stdout from oozie launcher:
Classpath         :
------------------------
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002
  /etc/hadoop/conf.cloudera.yarn
  /var/run/cloudera-scm-agent/process/1565-yarn-NODEMANAGER
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-cascading.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-format-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-encoding-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-annotations.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-hadoop-bundle-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-hadoop-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-generator.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-auth-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-thrift-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-auth.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-common.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-nfs.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-scrooge.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-annotations-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-scrooge-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-avro-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-column-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-pig-bundle-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-pig-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-cascading-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-avro-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-avro.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-common.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-thrift-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-cascading-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-encoding-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-pig.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-thrift.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-pig-bundle.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-column-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-common-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-generator-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-test-hadoop2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-nfs-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/hadoop-common-2.3.0-cdh5.0.1-tests.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-hadoop-bundle.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-hadoop-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-column.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-common-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-common-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-format.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-scrooge-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-encoding.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-hadoop.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-generator-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-pig-javadoc.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/parquet-format-sources.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jasper-runtime-5.5.23.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/mockito-all-1.8.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jsch-0.1.42.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/xz-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jets3t-0.9.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-configuration-1.6.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jersey-server-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/paranamer-2.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-logging-1.1.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-httpclient-3.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jersey-json-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jetty-util-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-beanutils-1.7.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jetty-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/protobuf-java-2.5.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jettison-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/httpcore-4.2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-net-3.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-io-2.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jasper-compiler-5.5.23.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/stax-api-1.0-2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/xmlenc-0.52.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-digester-1.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-math3-3.1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-compress-1.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-el-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/avro.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/httpclient-4.2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-lang-2.6.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jersey-core-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/netty-3.6.2.Final.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-collections-3.2.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/slf4j-log4j12.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/hue-plugins-3.5.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/java-xmlbuilder-0.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/snappy-java-1.0.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jsp-api-2.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/zookeeper-3.4.5-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/junit-4.8.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/slf4j-api-1.7.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jaxb-api-2.2.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/activation-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop/lib/jackson-xc-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/hadoop-hdfs-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/hadoop-hdfs.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/hadoop-hdfs-nfs.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/hadoop-hdfs-2.3.0-cdh5.0.1-tests.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/hadoop-hdfs-nfs-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jersey-server-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jetty-util-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jetty-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-io-2.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/xmlenc-0.52.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-el-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-lang-2.6.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jersey-core-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/jsp-api-2.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-hdfs/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-api.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-common.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-common-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-common-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-common.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-api-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-client-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-client.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-tests-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/hadoop-yarn-server-tests.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/xz-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jersey-server-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/javax.inject-1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-httpclient-3.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jersey-client-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jersey-json-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jetty-util-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jetty-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jettison-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-io-2.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/guice-servlet-3.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/stax-api-1.0-2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jline-0.9.94.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-lang-2.6.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jersey-core-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/aopalliance-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jersey-guice-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/zookeeper-3.4.5-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/guice-3.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/activation-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jasper-runtime-5.5.23.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jsch-0.1.42.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-datajoin-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/xz-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/junit-4.10.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-rumen.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-auth-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jets3t-0.9.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-auth.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jackson-jaxrs-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-configuration-1.6.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-distcp.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jersey-server-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/paranamer-2.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-logging-1.1.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-app.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-streaming.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-archives-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hamcrest-core-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/metrics-core-3.0.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-httpclient-3.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-gridmix.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jersey-json-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jetty-util-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-common.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-extras-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-beanutils-1.7.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jetty-6.1.26.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/protobuf-java-2.5.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jettison-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/httpcore-4.2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-net-3.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-io-2.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-beanutils-core-1.8.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jasper-compiler-5.5.23.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/stax-api-1.0-2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/xmlenc-0.52.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-digester-1.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-sls.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-datajoin.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-math3-3.1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-compress-1.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-gridmix-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jaxb-impl-2.2.3-1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-el-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/avro.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/httpclient-4.2.5.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-lang-2.6.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jersey-core-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-streaming-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-collections-3.2.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-extras.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.3.0-cdh5.0.1-tests.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/java-xmlbuilder-0.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/snappy-java-1.0.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-rumen-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-distcp-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jsp-api-2.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-sls-2.3.0-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/hadoop-archives.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/zookeeper-3.4.5-cdh5.0.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/asm-3.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jaxb-api-2.2.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/activation-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/jackson-xc-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/xz-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/junit-4.10.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/paranamer-2.3.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/javax.inject-1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/hamcrest-core-1.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/commons-io-2.4.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/avro.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-5.0.1-1.cdh5.0.1.p0.47/lib/hadoop-mapreduce/lib/guice-3.0.jar
  job.jar/job.jar
  job.jar/classes/
  job.jar/lib/*
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/oozie-hadoop-utils-2.3.0-cdh5.0.0.oozie-4.0.0-cdh5.0.0.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/tapad-udfs.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/oozie-sharelib-oozie-4.0.0-cdh5.0.0.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/jackson-core-asl-1.8.8.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/json-simple-1.1.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/jackson-mapper-asl-1.8.8.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/snappy-java-1.0.5.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/piggybank-cdh5.0.1.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/avro-1.7.5-cdh5.0.1.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/mysql-connector-java-5.1.25.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/first-party-with-deps.jar
  /d07/yarn/nm/usercache/oiepishkin/appcache/application_1405029975819_28701/container_1405029975819_28701_01_000002/vertica-jdk5-6.1.3-0.jar
1 ACCEPTED SOLUTION

avatar
Explorer

As a workaround we used jarjar ( https://code.google.com/p/jarjar/ ) to rename parquet.** to parquet15.** in our uberjar with scalding jobs.

View solution in original post

1 REPLY 1

avatar
Explorer

As a workaround we used jarjar ( https://code.google.com/p/jarjar/ ) to rename parquet.** to parquet15.** in our uberjar with scalding jobs.