YARN SLS

[#1]

Hello, I am using Cloudera VM for practice. I want to test the capacity and fair schedulers using YARN SLS. But I could not find the sls xml and scripts in the VM and was not able to find instructions on where to download them for testing.

If anyone has used it please guide me.

[#2 · Accepted solution]

You can go here and download for a specific version : https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/hadoop-sls/

The SLS scripts and config files are in the javadocs jar.

[#3]

Thanks Mario

[#4]

Hi Mario/All,

Am getting below erorr when I am trying to run Rumen which is required for YARN SLS.

java -cp "hadoop/*:hadoop/lib/*:hadoop-hdfs/*:hadoop-yarn/*:hadoop-mapreduce/*" org.apache.hadoop.tools.rumen.TraceBuilder /home/admin/nmakb/job-trace.json /home/admin/nmakb/topology.output hdfs://user/history/done
2015-03-24 04:45:16,693 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-03-24 04:45:17,602 WARN  [main] rumen.TraceBuilder (TraceBuilder.java:run(284)) - No job found in traces:

I have jobs info present in the job history folder. But not sure why its complaining and saying "No Job found in traces". Please help

[#5]

I also had this problem. I was giving wrong input path. Please check your input path full location. it should be like this:

hdfs:///tmp/hadoop-yarn/staging/history/done/2017/03/11/000000