Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hbase shell: Throws Master is initializing and region servers web server health bad.

Hbase shell: Throws Master is initializing and region servers web server health bad.

Explorer

Hi,

 

I have recently added hbase to the cluster and hbase master fails to become active and Cloudera manager states web server health bad for region servers. Hbase shell throws the below error when started with debug mode:

 

hbase(main):001:0> list
TABLE
18/07/05 16:42:10 DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x2646aeba5ba00bc, packet:: clientPath:null serverPath:null finished:false header:: 3,3 replyHeader:: 3,103079216982,0 request:: '/hbase,F response:: s{98784247892,98784247892,1530802039356,1530802039356,0,30,0,0,0,14,103079216929}
18/07/05 16:42:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 3ms
18/07/05 16:42:10 DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x2646aeba5ba00bc, packet:: clientPath:null serverPath:null finished:false header:: 4,4 replyHeader:: 4,103079216982,0 request:: '/hbase/master,F response:: #ffffffff000146d61737465723a363030303050ffffffc5ffffffb32ffffffabfffffff517f50425546a2da2073706d62617a62696d61737430312e7265796573686f6c64696e67732e636f6d10ffffffe0ffffffd4318ffffffe6ffffffefffffffc1ffffffdaffffffc62c10018ffffffeaffffffd43,s{103079216924,103079216924,1530808796198,1530808796198,0,0,0,100322652013723827,82,0,103079216924}
18/07/05 16:42:10 DEBUG ipc.RpcClientImpl: Use SIMPLE authentication for service MasterService, sasl=false
18/07/05 16:42:10 DEBUG ipc.RpcClientImpl: Connecting to hbase_host/IP:60000
Exception `NativeException' at /opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../lib/ruby/hbase/admin.rb:48 - org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=7, exceptions:
Thu Jul 05 16:42:10 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:11 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:11 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:11 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:12 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:14 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

Thu Jul 05 16:42:18 UTC 2018, RpcRetryingCaller{globalStartTime=1530808930636, pause=100, retries=7}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)

 

ERROR: org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2378)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableNames(MasterRpcServices.java:907)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55650)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)
Backtrace: org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1272)
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingStub.getTableNames(MasterProtos.java:58359)
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$5.getTableNames(ConnectionManager.java:2189)
org.apache.hadoop.hbase.client.HBaseAdmin$3.call(HBaseAdmin.java:540)
org.apache.hadoop.hbase.client.HBaseAdmin$3.call(HBaseAdmin.java:533)
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136)
org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4313)
org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4305)
org.apache.hadoop.hbase.client.HBaseAdmin.listTableNames(HBaseAdmin.java:533)
org.apache.hadoop.hbase.client.HBaseAdmin.listTableNames(HBaseAdmin.java:527)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:450)
org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:311)
org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:59)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:60)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:190)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:199)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
org.jruby.ast.LocalAsgnNode.interpret(LocalAsgnNode.java:123)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:191)
org.jruby.RubyClass.finvoke(RubyClass.java:552)
org.jruby.RubyBasicObject.send(RubyBasicObject.java:2777)
org.jruby.RubyKernel.send(RubyKernel.java:2105)
org.jruby.RubyKernel$s$send.call(RubyKernel$s$send.gen:65535)
org.jruby.internal.runtime.methods.JavaMethod$JavaMethodZeroOrOneOrNBlock.call(JavaMethod.java:266)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.FCallSpecialArgNode.interpret(FCallSpecialArgNode.java:39)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:295)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:229)
org.jruby.runtime.Block.yieldSpecific(Block.java:99)
org.jruby.ast.ZYieldNode.interpret(ZYieldNode.java:25)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:191)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153)
org.jruby.ast.FCallSpecialArgBlockNode.interpret(FCallSpecialArgBlockNode.java:34)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:233)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:215)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:203)
org.jruby.ast.CallSpecialArgNode.interpret(CallSpecialArgNode.java:69)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:233)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:215)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:203)
org.jruby.ast.FCallSpecialArgNode.interpret(FCallSpecialArgNode.java:41)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:190)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:199)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:312)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:169)
org.jruby.ast.CallSpecialArgNode.interpret(CallSpecialArgNode.java:67)
org.jruby.ast.LocalAsgnNode.interpret(LocalAsgnNode.java:123)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:183)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135)
org.jruby.ast.VCallNode.interpret(VCallNode.java:86)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.RootNode.interpret(RootNode.java:129)
org.jruby.evaluator.ASTInterpreter.INTERPRET_EVAL(ASTInterpreter.java:95)
org.jruby.evaluator.ASTInterpreter.evalWithBinding(ASTInterpreter.java:166)
org.jruby.RubyKernel.evalCommon(RubyKernel.java:1155)
org.jruby.RubyKernel.eval(RubyKernel.java:1112)
org.jruby.RubyKernel$s$0$3$eval.call(RubyKernel$s$0$3$eval.gen:65535)
org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:181)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:282)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:71)
org.jruby.ast.FCallManyArgsNode.interpret(FCallManyArgsNode.java:60)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:120)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:134)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:174)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:282)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:71)
org.jruby.ast.CallManyArgsNode.interpret(CallManyArgsNode.java:59)
org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:233)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:215)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:203)
org.jruby.ast.CallTwoArgNode.interpret(CallTwoArgNode.java:59)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:295)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:229)
org.jruby.runtime.Block.yieldSpecific(Block.java:99)
org.jruby.ast.ZYieldNode.interpret(ZYieldNode.java:25)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)
org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:212)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:207)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:322)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:178)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:187)
org.jruby.ast.FCallOneArgBlockNode.interpret(FCallOneArgBlockNode.java:34)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:260)
org.jruby.runtime.Block.yieldSpecific(Block.java:117)
org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.IfNode.interpret(IfNode.java:117)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.ast.RescueNode.executeBody(RescueNode.java:216)
org.jruby.ast.RescueNode.interpretWithJavaExceptions(RescueNode.java:120)
org.jruby.ast.RescueNode.interpret(RescueNode.java:110)
org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:295)
org.jruby.runtime.InterpretedBlock.yieldSpecific(InterpretedBlock.java:229)
org.jruby.runtime.Block.yieldSpecific(Block.java:99)
org.jruby.RubyKernel.loop(RubyKernel.java:1439)
org.jruby.RubyKernel$s$0$0$loop.call(RubyKernel$s$0$0$loop.gen:65535)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153)
org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:111)
org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:347)
org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:304)
org.jruby.runtime.Block.yield(Block.java:130)
org.jruby.RubyContinuation.enter(RubyContinuation.java:106)
org.jruby.RubyKernel.rbCatch(RubyKernel.java:1212)
org.jruby.RubyKernel$s$1$0$rbCatch.call(RubyKernel$s$1$0$rbCatch.gen:65535)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:322)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:178)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:187)
org.jruby.ast.FCallOneArgBlockNode.interpret(FCallOneArgBlockNode.java:34)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:191)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153)
org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)
org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104)
org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147)
org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:183)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.block_2$RUBY$start(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb:205)
opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$block_2$RUBY$start.call(opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$block_2$RUBY$start:65535)
org.jruby.runtime.CompiledBlock.yield(CompiledBlock.java:112)
org.jruby.runtime.CompiledBlock.yield(CompiledBlock.java:95)
org.jruby.runtime.Block.yield(Block.java:130)
org.jruby.RubyContinuation.enter(RubyContinuation.java:106)
org.jruby.RubyKernel.rbCatch(RubyKernel.java:1212)
org.jruby.RubyKernel$s$1$0$rbCatch.call(RubyKernel$s$1$0$rbCatch.gen:65535)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:322)
org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:178)
org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:187)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.method__5$RUBY$start(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb:204)
opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$method__5$RUBY$start.call(opt$cloudera$parcels$CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3$lib$hbase$bin$$_dot_dot_$bin$hirb$method__5$RUBY$start:65535)
org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:203)
org.jruby.internal.runtime.methods.CompiledMethod.call(CompiledMethod.java:255)
org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292)
org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.__file__(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb:210)
opt.cloudera.parcels.CDH_minus_5_dot_14_dot_2_minus_1_dot_cdh5_dot_14_dot_2_dot_p0_dot_3.lib.hbase.bin.$_dot_dot_.bin.hirb.load(/opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hbase/bin/../bin/hirb.rb)
org.jruby.Ruby.runScript(Ruby.java:697)
org.jruby.Ruby.runScript(Ruby.java:690)
org.jruby.Ruby.runNormally(Ruby.java:597)
org.jruby.Ruby.runFromMain(Ruby.java:446)
org.jruby.Main.doRunFromMain(Main.java:369)
org.jruby.Main.internalRun(Main.java:258)
org.jruby.Main.run(Main.java:224)
org.jruby.Main.run(Main.java:208)
org.jruby.Main.main(Main.java:188)

List all tables in hbase. Optional regular expression parameter could
be used to filter the output. Examples:

hbase> list
hbase> list 'abc.*'
hbase> list 'ns:abc.*'
hbase> list 'ns:.*'


hbase(main):002:0> 18/07/05 16:42:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 3ms
18/07/05 16:42:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:43:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:43:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:43:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:44:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:44:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:44:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:45:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 2ms
18/07/05 16:45:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:45:50 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:46:10 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms
18/07/05 16:46:30 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x2646aeba5ba00bc after 1ms

 

I tried stopping hbase but cm has to force kill it.

Screen Shot 2018-07-05 at 12.54.27 PM.png

 

 

 

Thanks & Regards,

Siva

 

 

 

1 REPLY 1

Re: Hbase shell: Throws Master is initializing and region servers web server health bad.

Explorer

Antivirus is blocking the hbase region server to start and master is waiting on the heartbeat from any region server. Resolved it by adding an exception for /var/log/hbase path in Antivirus.