Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hivemetastore doing GC on hdp 3.1 with heap size 3GB and metastore processs terminates

Highlighted

hivemetastore doing GC on hdp 3.1 with heap size 3GB and metastore processs terminates

New Contributor

We are using hdp 3.1 We have give hive metastore heap 3GB of memory but it is doing GC and metastore process dies after that. the heapdump (hms_heapdump.hprof) showing the below in some class MutableQuantiles? Any pointers what could be going on wrong here.


108295-1556342295259.png

3 REPLIES 3

Re: hivemetastore doing GC on hdp 3.1 with heap size 3GB and metastore processs terminates

New Contributor

The image of heapdump not showing up so pasting the heapdump


Class Name | Shallow Heap | Retained Heap | Percentage

------------------------------------------------------------------------------------------------------------------------------------

java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue @ 0x70128be78 | 32 | 2,997,787,240 | 97.85%

|- java.util.concurrent.RunnableScheduledFuture[898656] @ 0x7afe00000 | 3,594,640 | 2,997,787,184 | 97.85%

| |- java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask @ 0x79ba68588| 72 | 4,656 | 0.00%

| | '- java.util.concurrent.Executors$RunnableAdapter @ 0x79ba685d0 | 24 | 4,584 | 0.00%

| | '- org.apache.hadoop.metrics2.lib.MutableQuantiles$RolloverSample @ 0x79ba685e8| 16 | 4,560 | 0.00%

------------------------------------------------------------------------------------------------------------------------------------


Re: hivemetastore doing GC on hdp 3.1 with heap size 3GB and metastore processs terminates

Mentor

@bharat jain

Can you attach the HS2 logs, without the logs it's difficult to guess?

HTH


Re: hivemetastore doing GC on hdp 3.1 with heap size 3GB and metastore processs terminates

New Contributor

My colleague Rajat has created a ticket for this at hadoop

https://issues.apache.org/jira/browse/HADOOP-16278

and this might be related to a similar issue reported at

https://issues.apache.org/jira/browse/HADOOP-16248

Don't have an account?
Coming from Hortonworks? Activate your account here