Reply
Explorer
Posts: 11
Registered: ‎11-01-2013

HBASE Master not starting

[ Edited ]

Hello, HBASE went down today morning - no chnages were made to any configuration.

 

Here is the error in the log - 

Master exiting
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2110)
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:152)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:104)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2124)
Caused by: javax.security.auth.login.LoginException: Unable to obtain password from user

 

Verified the Kerberos and Trust with Active Directory. Regenerated the credentials and it worked fine.

 

All the other services are up and running so Kerberos as such is working fine.

 

What might be the issue?

 

Murthy

 

Highlighted
Posts: 1,893
Kudos: 432
Solutions: 302
Registered: ‎07-31-2013

Re: HBASE Master not starting

Without the extended stack trace (which would carry the reason behind the javax exception) it is difficult to precisely pin-point the issue.

However, it is more than likely that the principals on your KDC (or AD?) for these services was likely changed, causing the exit at the next renewal time, since the service-owned keytabs were now stale. This could explain why a regenerate and restart then helped.

Your KDC/KADMIN logs, or equivalent of these in AD, can help you trace such things down further. At CM and CDH end, unless you manually request a credentials regeneration, we do not alter/re-create principals.
Announcements