I am getting following error in HDinsight cluster while submitting spark job
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.metrics2.sink.WasbAzureIaasSink
So wondering which jar file has `org.apache.hadoop.metrics2.sink.WasbAzureIaasSink` class ?
So, usually metrics2 package classes will be found under "hadoop-common". This is of course Microsoft variation, so I think a good place to start would in one of the subdirectories under /usr/lib of your HDInsight cluster.
Do you have a jar file named WindowsAzureTableSink-*.jar.?
I have this jar file
also copied it to
is there some JAR library containing required file? We have to use Maven for our application but can't find the WasbAzureIaasSink class