Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hbase Region Server shutting down with ZooKeeper SessionExpiredException

Highlighted

Hbase Region Server shutting down with ZooKeeper SessionExpiredException

Hi Everyone,

We are getting below exception.

org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired

After that Region Server is shutting down. According to technical notes, the problem occurs because of a garbage collector pause time.

gc-log.pdf is the gc stats before shutting down. We have long gc pauses and it happens very often.

The reason is specifically in the young generation gc. So we decrease the young generation heap to 2500 mb. And also added below gc parameters but it didn't solve our problem.

-XX:+UseConcMarkSweepGC
-XX:PermSize=128m 
-XX:MaxPermSize=128m 
-XX:SurvivorRatio=4 
-XX:+PerfDisableSharedMem 
-XX:ParallelGCThreads=8 
-XX:CMSInitiatingOccupancyFraction=50 
-XX:+UseCMSInitiatingOccupancyOnly 

What steps do I take to solve this?

Thanks.

3 REPLIES 3

Re: Hbase Region Server shutting down with ZooKeeper SessionExpiredException

Contributor

This question has been answered in this community before, please search for the same.

Also have a look at https://superuser.blog/hbase-dead-regionserver/

Highlighted

Re: Hbase Region Server shutting down with ZooKeeper SessionExpiredException

Thanks for the response but like I said on my question, I read the similar problems and solution is the tuning gc.

I didn't find any context that resolves the region server gc pause problem.

Highlighted

Re: Hbase Region Server shutting down with ZooKeeper SessionExpiredException

New Contributor

Any update on this ? Can anyone please check and provide ?

Don't have an account?
Coming from Hortonworks? Activate your account here