question Re: Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0 in Archives of Support Questions (Read Only)

Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0

kums — Thu, 06 Sep 2018 21:35:22 GMT

We upgraded our cluster last week to HDP 2.6.5.0 since then Hiveserver2 went down twice due to Java Heap size.

Currently "Hiveserver2 Heap Size" is set to 512MB.

I am looking for any documentation that says minimum recommendation from HortonWorks on configs specific for versions.

Thanks

Kumar

Re: Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0

sandyy006 — Fri, 07 Sep 2018 19:36:41 GMT

@Kumar Veerappan

Sizing HiveServer2 Heap Memory
The following are general recommendations for sizing heap memory of a HiveServer2 instance:
1 to 20 concurrent executing queries: Set to 6 GB heap size.
21 to 40 concurrent executing queries: Set to 12 GB heap size.
More than 40 concurrent executing queries: Create a new HiveServer2 instance. See Multiple HiveServer2Instances for Different Workloads for how to add a HiveServer2 instance.

Please refer the official doc : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hive-performance-tuning/content/ch_connectivity-admission-control.html#guidelines-hiveserver2-heaps

Re: Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0

kgautam — Mon, 10 Sep 2018 18:35:07 GMT

Kindly find the heap sizing of all the services for 80 Node HDP cluster (HDP-2.6.4).

https://community.hortonworks.com/content/kbentry/209792/tuning-heap-sizing-for-a-80-node-hdp-cluster.html

https://community.hortonworks.com/articles/209789/making-hiveserver2-instance-handle-more-than-500-c.html

Re: Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0

maheshchimmiri — Mon, 28 Feb 2022 17:04:38 GMT

Hello @kums

Hs2 will play key role to execute the quires and retrieve the data from filesystem. please follow below link for best practices of Hs2 heap recommendations.

Hiveserver2 Heap Size Recommendations