Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HBASE Master not starting

HBASE Master not starting

Explorer

Hello, HBASE went down today morning - no chnages were made to any configuration.

 

Here is the error in the log - 

Master exiting
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2110)
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:152)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:104)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2124)
Caused by: javax.security.auth.login.LoginException: Unable to obtain password from user

 

Verified the Kerberos and Trust with Active Directory. Regenerated the credentials and it worked fine.

 

All the other services are up and running so Kerberos as such is working fine.

 

What might be the issue?

 

Murthy

 

1 REPLY 1
Highlighted

Re: HBASE Master not starting

Master Guru
Without the extended stack trace (which would carry the reason behind the javax exception) it is difficult to precisely pin-point the issue.

However, it is more than likely that the principals on your KDC (or AD?) for these services was likely changed, causing the exit at the next renewal time, since the service-owned keytabs were now stale. This could explain why a regenerate and restart then helped.

Your KDC/KADMIN logs, or equivalent of these in AD, can help you trace such things down further. At CM and CDH end, unless you manually request a credentials regeneration, we do not alter/re-create principals.