Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0

[#1]

We upgraded our cluster last week to HDP 2.6.5.0 since then Hiveserver2 went down twice due to Java Heap size.

Currently "Hiveserver2 Heap Size" is set to 512MB.

I am looking for any documentation that says minimum recommendation from HortonWorks on configs specific for versions.

Thanks

Kumar

[#2 · Accepted solution]

@Kumar Veerappan

Sizing HiveServer2 Heap Memory
The following are general recommendations for sizing heap memory of a HiveServer2 instance:
1 to 20 concurrent executing queries: Set to 6 GB heap size.
21 to 40 concurrent executing queries: Set to 12 GB heap size.
More than 40 concurrent executing queries: Create a new HiveServer2 instance. See Multiple HiveServer2Instances for Different Workloads for how to add a HiveServer2 instance.

Please refer the official doc : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hive-performance-tuning/content/ch_conne...

[#3]

Kindly find the heap sizing of all the services for 80 Node HDP cluster (HDP-2.6.4).

https://community.hortonworks.com/content/kbentry/209792/tuning-heap-sizing-for-a-80-node-hdp-cluste...

https://community.hortonworks.com/articles/209789/making-hiveserver2-instance-handle-more-than-500-c...

[#4]

Hello @kums 

Hs2 will play key role to execute the quires and retrieve the data from filesystem. please follow below link for best practices of Hs2 heap recommendations.

Hiveserver2 Heap Size Recommendations