Support Questions
Find answers, ask questions, and share your expertise

Java Heap size recommendation for Hiveserver2 in HDP2.6.5.0

Expert Contributor

We upgraded our cluster last week to HDP 2.6.5.0 since then Hiveserver2 went down twice due to Java Heap size.

Currently "Hiveserver2 Heap Size" is set to 512MB.

I am looking for any documentation that says minimum recommendation from HortonWorks on configs specific for versions.

Thanks

Kumar

1 ACCEPTED SOLUTION

@Kumar Veerappan
Sizing HiveServer2 Heap Memory
The following are general recommendations for sizing heap memory of a HiveServer2 instance:
1 to 20 concurrent executing queries: Set to 6 GB heap size.
21 to 40 concurrent executing queries: Set to 12 GB heap size.
More than 40 concurrent executing queries: Create a new HiveServer2 instance. See Multiple HiveServer2Instances for Different Workloads for how to add a HiveServer2 instance.

Please refer the official doc : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hive-performance-tuning/content/ch_conne...

View solution in original post

3 REPLIES 3

@Kumar Veerappan
Sizing HiveServer2 Heap Memory
The following are general recommendations for sizing heap memory of a HiveServer2 instance:
1 to 20 concurrent executing queries: Set to 6 GB heap size.
21 to 40 concurrent executing queries: Set to 12 GB heap size.
More than 40 concurrent executing queries: Create a new HiveServer2 instance. See Multiple HiveServer2Instances for Different Workloads for how to add a HiveServer2 instance.

Please refer the official doc : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hive-performance-tuning/content/ch_conne...

New Contributor

Hello @kums 

 

Hs2 will play key role to execute the quires and retrieve the data from filesystem. please follow below link for best practices of Hs2 heap recommendations.

 

Hiveserver2 Heap Size Recommendations

 

; ;