Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Highlighted

Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Rising Star

I am getting following error in HDinsight cluster while submitting spark job

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.metrics2.sink.WasbAzureIaasSink 

So wondering which jar file has `org.apache.hadoop.metrics2.sink.WasbAzureIaasSink` class ?

3 REPLIES 3

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Super Guru

@roy p

So, usually metrics2 package classes will be found under "hadoop-common". This is of course Microsoft variation, so I think a good place to start would in one of the subdirectories under /usr/lib of your HDInsight cluster.

Do you have a jar file named WindowsAzureTableSink-*.jar.?

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

Rising Star

I have this jar file

/usr/hdp/2.4.2.0-258/hadoop/src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/sink/WindowsAzureTableSink.java

also copied it to

/usr/hdp/2.4.2.0-258/spark/lib/
/usr/hdp/2.4.2.0-258/hadoop/lib/

Re: Which jar has org.apache.hadoop.metrics2.sink.WasbAzureIaasSink

New Contributor

is there some JAR library containing required file? We have to use Maven for our application but can't find the WasbAzureIaasSink class

Don't have an account?
Coming from Hortonworks? Activate your account here