Reply
Explorer
Posts: 23
Registered: ‎06-06-2018

Hbase shell: Throws Master is initializing and region servers web server health bad.

[ Edited ]

Hi,

 

I have recently added hbase to the cluster and hbase master fails to become active and Cloudera manager states web server health bad for region servers. Hbase shell throws the below error when started with debug mode:

 

hbase(main):001:0> list
TABLE
18/07/05 16:42:10 DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x2646aeba5ba00bc, packet:: clientPath:null serverPath:null finished:false header:: 3,3 replyHeader:: 3,103079216982,0 request:: '/hbase,F response:: s{98784247892,98784247892,1530802039356,1530802039356,0,30,0,0,0,14,103079216929}
18/07/05 16:42:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 3ms
18/07/05 16:42:10 DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x2646aeba5ba00bc, packet:: clientPath:null serverPath:null finished:false header:: 4,4 replyHeader:: 4,103079216982,0 request:: '/hbase/master,F response:: #ffffffff000146d61737465723a363030303050ffffffc5ffffffb32ffffffabfffffff517f50425546a2da2073706d62617a62696d61737430312e7265796573686f6c64696e67732e636f6d10ffffffe0ffffffd4318ffffffe6ffffffefffffffc1ffffffdaffffffc62c10018ffffffeaffffffd43,s{103079216924,103079216924,1530808796198,1530808796198,0,0,0,100322652013723827,82,0,103079216924}
18/07/05 16:42:10 DEBUG ipc.RpcClientImpl: Use SIMPLE authentication for service MasterService, sasl=false
18/07/05 16:42:10 DEBUG ipc.RpcClientImpl: Connecting to hbase_host/IP:60000
Exception `NativeException' at /opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../lib/ruby/hbase/admin.rb:48 - org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=7, exceptions:
Thu Jul 05 16:42:10 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:11 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:11 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:11 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:12 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:14 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:18 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

 

ERROR: org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)
Backtrace: org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1272)
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingStub.getTableNames(MasterProtos.java:58359)
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$5.getTableNames(ConnectionManager.java:2189)
org.apache.hadoop.hbase.client.HBaseAdmin$3.call(HBaseAdmin.java:540)
org.apache.hadoop.hbase.client.HBaseAdmin$3.call(HBaseAdmin.java:533)
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136)
org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4313)
org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4305)
org.apache.hadoop.hbase.client.HBaseAdmin.listTableNames(HBaseAdmin.java:533)
org.apache.hadoop.hbase.client.HBaseAdmin.listTableNames(HBaseAdmin.java:527)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:450)
org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:311)
org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:59)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:60)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:190)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:199)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
org.jruby.ast.LocalAsgnNode.interpret(LocalAsgnNode.java:123)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:191)
org.jruby.RubyClass.finvoke(RubyClass.java:552)
org.jruby.RubyBasicObject.send(RubyBasicObject.java:2777)
org.jruby.RubyKernel.send(RubyKernel.java:2105)
org.jruby.RubyKernel$s$send.call(RubyKernel$s$send.gen:65535)
org.jruby.internal.runtime.methods.JavaMethod$JavaMethodZeroOrOneOrNBlock.call(JavaMethod.java:266)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.FCallSpecialArgNode.interpret(FCallSpecialArgNode.java:39)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:295)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:229)
org.jruby.runtime.Block.yieldSpecific(Block.java:99)
org.jruby.ast.ZYieldNode.interpret(ZYieldNode.java:25)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:191)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153)
org.jruby.ast.FCallSpecialArgBlockNode.interpret(FCallSpecialArgBlockNode.java:34)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:233)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:215)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:203)
org.jruby.ast.CallSpecialArgNode.interpret(CallSpecialArgNode.java:69)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:233)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:215)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:203)
org.jruby.ast.FCallSpecialArgNode.interpret(FCallSpecialArgNode.java:41)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:190)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:199)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.CallSpecialArgNode.interpret(CallSpecialArgNode.java:67)
org.jruby.ast.LocalAsgnNode.interpret(LocalAsgnNode.java:123)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:183)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135)
org.jruby.ast.VCallNode.interpret(VCallNode.java:86)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.RootNode.interpret(RootNode.java:129)
org.jruby.evaluator.ASTInterpreter.INTERPRET_EVAL(ASTInterpreter.java:95)
org.jruby.evaluator.ASTInterpreter.evalWithBinding(ASTInterpreter.java:166)
org.jruby.RubyKernel.evalCommon(RubyKernel.java:1155)
org.jruby.RubyKernel.eval(RubyKernel.java:1112)
org.jruby.RubyKernel$s$0$3$eval.call(RubyKernel$s$0$3$eval.gen:65535)
org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:181)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:282)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:71)
org.jruby.ast.FCallManyArgsNode.interpret(FCallManyArgsNode.java:60)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:120)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:134)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:174)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:282)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:71)
org.jruby.ast.CallManyArgsNode.interpret(CallManyArgsNode.java:59)
org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:233)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:215)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:203)
org.jruby.ast.CallTwoArgNode.interpret(CallTwoArgNode.java:59)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:295)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:229)
org.jruby.runtime.Block.yieldSpecific(Block.java:99)
org.jruby.ast.ZYieldNode.interpret(ZYieldNode.java:25)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)
org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:212)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:207)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:322)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:178)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:187)
org.jruby.ast.FCallOneArgBlockNode.interpret(FCallOneArgBlockNode.java:34)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:260)
org.jruby.runtime.Block.yieldSpecific(Block.java:117)
org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.IfNode.interpret(IfNode.java:117)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:295)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:229)
org.jruby.runtime.Block.yieldSpecific(Block.java:99)
org.jruby.RubyKernel.loop(RubyKernel.java:1439)
org.jruby.RubyKernel$s$0$0$loop.call(RubyKernel$s$0$0$loop.gen:65535)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153)
org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:347)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:304)
org.jruby.runtime.Block.yield(Block.java:130)
org.jruby.RubyContinuation.enter(RubyContinuation.java:106)
org.jruby.RubyKernel.rbCatch(RubyKernel.java:1212)
org.jruby.RubyKernel$s$1$0$rbCatch.call(RubyKernel$s$1$0$rbCatch.gen:65535)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:322)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:178)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:187)
org.jruby.ast.FCallOneArgBlockNode.interpret(FCallOneArgBlockNode.java:34)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:191)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153)
org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:183)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.block_2$RUBY$start(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb:205)
opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$block_2$RUBY$start.call(opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$block_2$RUBY$start:65535)
org.jruby.runtime.CompiledBlock.yield(CompiledBlock.java:112)
org.jruby.runtime.CompiledBlock.yield(CompiledBlock.java:95)
org.jruby.runtime.Block.yield(Block.java:130)
org.jruby.RubyContinuation.enter(RubyContinuation.java:106)
org.jruby.RubyKernel.rbCatch(RubyKernel.java:1212)
org.jruby.RubyKernel$s$1$0$rbCatch.call(RubyKernel$s$1$0$rbCatch.gen:65535)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:322)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:178)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:187)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.method__5$RUBY$start(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb:204)
opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$method__5$RUBY$start.call(opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$method__5$RUBY$start:65535)
org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:203)
org.jruby.internal.runtime.methods.CompiledMethod.call(CompiledMethod.java:255)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.__file__(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb:210)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.load(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb)
org.jruby.Ruby.runScript(Ruby.java:697)
org.jruby.Ruby.runScript(Ruby.java:690)
org.jruby.Ruby.runNormally(Ruby.java:597)
org.jruby.Ruby.runFromMain(Ruby.java:446)
org.jruby.Main.doRunFromMain(Main.java:369)
org.jruby.Main.internalRun(Main.java:258)
org.jruby.Main.run(Main.java:224)
org.jruby.Main.run(Main.java:208)
org.jruby.Main.main(Main.java:188)

List all tables in hbase. Optional regular expression parameter could
be used to filter the output. Examples:

hbase> list
hbase> list 'abc.*'
hbase> list 'ns:abc.*'
hbase> list 'ns:.*'


hbase(main):002:0> 18/07/05 16:42:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 3ms
18/07/05 16:42:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:43:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:43:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:43:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:44:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:44:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:44:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:45:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 2ms
18/07/05 16:45:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:45:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:46:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:46:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms

 

I tried stopping hbase but cm has to force kill it.

Screen Shot 2018-07-05 at 12.54.27 PM.png

 

 

 

Thanks & Regards,

Siva

 

 

 

Highlighted
Explorer
Posts: 23
Registered: ‎06-06-2018

Re: Hbase shell: Throws Master is initializing and region servers web server health bad.

Antivirus is blocking the hbase region server to start and master is waiting on the heartbeat from any region server. Resolved it by adding an exception for /var/log/hbase path in Antivirus.

Announcements