- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HDP Sandbox 2.6 Hive/Hive 2 'SELECT COUNT' or 'SELECT DISTINCT' hangs
- Labels:
-
Apache Hive
Created 05-25-2017 02:52 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I just used the tutorial table drivers/timesheets table.
SELECT dirverid from drivers;
runs fine. It's a small table. But:
SELECT DISTINCT driverid from drivers;
or
SELECT COUNT(*) from drivers;
just hangs, never completes. I have to restart HIVE to stop it running.
I just use Virtual Box load the downloaded HortonWorks Sandbox 2.6, no configuration changes.
It works with HDP 2.5 though.
Created on 05-25-2017 03:34 PM - edited 08-18-2019 01:10 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I faced a similar issue in the past and solved it by adjusting the Hive settings in the sandbox as below:
1) In Ambari, select "Hive" from the left menu then the "Configs" tab and the "Settings" sub-tab
2) Scroll down to the bottom of the page and modify the "HeveServer2 Heap Size", "Metastore Heap Size" as well as any other flagged items (possibly "Memory for Map Join"). If you hover next to each item, Ambari will make recommendations for the values to set, so feel free to use those by selecting the "set recommended" icon that appears.
3) Save and click "restart affected" services near the top of the page.
Try the above and let us know if it works or not.
As always, if you find any post here helpful, don't forget to "accept" an answer.
Created on 05-25-2017 03:34 PM - edited 08-18-2019 01:10 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I faced a similar issue in the past and solved it by adjusting the Hive settings in the sandbox as below:
1) In Ambari, select "Hive" from the left menu then the "Configs" tab and the "Settings" sub-tab
2) Scroll down to the bottom of the page and modify the "HeveServer2 Heap Size", "Metastore Heap Size" as well as any other flagged items (possibly "Memory for Map Join"). If you hover next to each item, Ambari will make recommendations for the values to set, so feel free to use those by selecting the "set recommended" icon that appears.
3) Save and click "restart affected" services near the top of the page.
Try the above and let us know if it works or not.
As always, if you find any post here helpful, don't forget to "accept" an answer.
Created 05-25-2017 04:35 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, this fixed the issue.
One extra is in 'Tez' container size, I changed it to recommended size, was 256MB, which might be the problem.
Created 05-25-2017 04:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Awesome! Glad it worked.