- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Increasing hive.server2.thrift.max.worker.threads from default 500
- Labels:
-
Apache Hive
Created ‎05-25-2017 03:23 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
What are the implications of increasing the
hive.server2.thrift.max.worker.threads from default 500, other than lot more connections on the Production Oracle database?
Thanks,
Kiran
Created ‎05-31-2017 03:13 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have increased hive.server2.thrift.max.worker.threads from default 500 to 1500 because of one issue with WinSQL Lite which was taking huge connection thread because of some bug in WinSQL Lite. What I have faced is when the connections threads reached 500 it was not allowing any new users to connect to Hiveserver2 using beeline. So I have increased it from 500 to 1500 to avoid this problem but usually, this will not happen if you are connected through beeline on edge node. 500 threads should be good enough to handle for one HiveServer2.
Command to check number of threads on Hiveserver2 node:
jstack -l <HiveServere2_ProccessId> | grep ".Thread.Stat" | wc -l
Hope this helps you.
Created ‎08-09-2017 01:48 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The recommended approach is to add another Hiveserver2 on another machine. Increasing the thread count will help in the short term, but is not the recommended solution.
