Support Questions
Find answers, ask questions, and share your expertise

Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Highlighted

Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Rising Star

I am getting following error in HDinsight cluster while submitting spark job

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.metrics2.sink.WasbAzureIaasSink 

So wondering which jar file has `org.apache.hadoop.metrics2.sink.WasbAzureIaasSink` class ?

4 REPLIES 4
Highlighted

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Super Guru

@roy p

So, usually metrics2 package classes will be found under "hadoop-common". This is of course Microsoft variation, so I think a good place to start would in one of the subdirectories under /usr/lib of your HDInsight cluster.

Do you have a jar file named WindowsAzureTableSink-*.jar.?

Highlighted

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Rising Star

I have this jar file

/usr/hdp/2.4.2.0-258/hadoop/src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/sink/WindowsAzureTableSink.java

also copied it to

/usr/hdp/2.4.2.0-258/spark/lib/
/usr/hdp/2.4.2.0-258/hadoop/lib/

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Explorer

is there some JAR library containing required file? We have to use Maven for our application but can't find the WasbAzureIaasSink class

Highlighted

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

New Contributor

Did anyone find a solution to this, I am not able to locate this jar with hdp 3.1.1.3.1.2.1-1