Community Articles

Find and share helpful community-sourced technical articles.
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
Labels (2)
avatar

This article is an extension to the official HDP document.

Apart from following the steps listed in this document, you must perform the following checks to ensure the hook is configured correctly and does not result in errors when you start executing queries in Hive.

1. In hive-site.xml, verify hive.server2.async.exec.threads is not set to 1. If so, then increase to 100.

2. In hive-site.xml, verify the max thread pool size is not set to 1. Increase it to 5 to begin with and you may need to increase it further depending on the load.

Recommended values:

<property>
   <name>atlas.hook.hive.maxThreads</name>
   <value>5</value>
</property>

<property>
   <name>hive.server2.async.exec.threads</name>
   <value>100</value>
</property>

4,592 Views
Comments

Hi Dinesh.
These are default values for recent versions of Hive (0.13.0 and later).
Sources:
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hi...
and
http://atlas.apache.org/Bridge-Hive.html