Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

HDP 3 upgrade from 2.6 / metrics collector java class issues

avatar
New Member

Having some issues getting the Ambari metrics HBase master process / collector process to start. Leaning towards trying to add to classpath for zookeeper? Everything else is working ok.

2018-08-20 21:32:26,397 INFO [main] zookeeper.MiniZooKeeperCluster: Started MiniZooKeeperCluster and ran successful 'stat' on client port=61181 2018-08-20 21:32:26,397 INFO [main] master.HMasterCommandLine: Starting up instance of localHBaseCluster; master=1, regionserversCount=1 2018-08-20 21:32:26,869 INFO [main] regionserver.RSRpcServices: master/nodex/192.168.x.x:0 server-side HConnection retries=350 2018-08-20 21:32:27,078 INFO [main] ipc.SimpleRpcScheduler: Using fifo as user call queue, count=3 2018-08-20 21:32:27,204 INFO [main] ipc.RpcServer: master/nodex/192.168.x.x:0: started 10 reader(s). 2018-08-20 21:32:27,276 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-08-20 21:32:27,325 ERROR [main] master.HMasterCommandLine: Master exiting java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMasterorg.apache.commons.configuration2.convert.ListDelimiterHandler at org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:143) at org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:217) at org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:153) at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:226) at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2838) Caused by: java.lang.NoClassDefFoundError: org/apache/commons/configuration2/convert/ListDelimiterHandler at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.metrics2.impl.MetricsConfig.getPlugin(MetricsConfig.java:196) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.newSink(MetricsSystemImpl.java:529) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configureSinks(MetricsSystemImpl.java:501) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configure(MetricsSystemImpl.java:480) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.start(MetricsSystemImpl.java:189) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:164) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:54) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50) at org.apache.hadoop.hbase.metrics.BaseSourceImpl$DefaultMetricsSystemInitializer.init(BaseSourceImpl.java:48) at org.apache.hadoop.hbase.metrics.BaseSourceImpl.<init>(BaseSourceImpl.java:71) at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:64) at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48) at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38) at org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:39) at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:2013) at org.apache.hadoop.hbase.regionserver.RSRpcServices.<init>(RSRpcServices.java:921) at org.apache.hadoop.hbase.master.MasterRpcServices.<init>(MasterRpcServices.java:248) at org.apache.hadoop.hbase.master.HMaster.createRpcServices(HMaster.java:595) at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:557) at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:425) at org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:309) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:139) ... 7 more Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration2.convert.ListDelimiterHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

1 ACCEPTED SOLUTION

avatar

@Nathan Rutland

Did you apply post installation tasks? can you run "rpm -qa | grep metrics" and see if those are pointing to 2.7 (ambari) version ? if not you will have to do https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.0.0/bk_ambari-upgrade/content/upgrade_ambari_me...

View solution in original post

3 REPLIES 3

avatar

@Nathan Rutland

Did you apply post installation tasks? can you run "rpm -qa | grep metrics" and see if those are pointing to 2.7 (ambari) version ? if not you will have to do https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.0.0/bk_ambari-upgrade/content/upgrade_ambari_me...

avatar

@Nathan Rutland thanks for confirming that it has helped. Can you please mark this as correct answer.

avatar
New Member

@amarnath reddy pappu

I thought I updated everything on that node. The other 2 rpm's were 2.7 but the collector was 2.6. Did the yum upgrade and all is well. Thanks for your assistance. Very apprecitated. I'm going to snapshot all of the VMs now.