Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cannot get a simple query on beeline to run using either TEZ or MR

Cannot get a simple query on beeline to run using either TEZ or MR

Rising Star

- Setup 3 node hadoop cluster on Amazon using Ambari. Each instance is r3.xlarge (30GB RAM)

- I adjusted the YARN cluster params per this link

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.6/bk_installing_manually_book/content/determi...

The query is

set hive.execution.engine=tez; (I tried "mr" as well )

select zip, count(cid) as ginti from (select split(ln,',')[0] as cid, split(ln,',')[1] as zip from utils.file1 where fn='foo1.csv') dd group by zip order by ginti desc

The CSV is a 2 column data with 18 million rows

RESULT

The query just seems to hang and does not return with results !

3 REPLIES 3
Highlighted

Re: Cannot get a simple query on beeline to run using either TEZ or MR

Guru

Can you share the hiveserver2 logs ?

Highlighted

Re: Cannot get a simple query on beeline to run using either TEZ or MR

Master Collaborator

Can you provide more details on what you mean by query hang? Does the YARN application associated with the session gets into the RUNNING state? Check the Resource Manager UI to check on resource usage. Also you might want to run the subquery separately

select split(ln,',')[0] as cid, split(ln,',')[1] as zip from utils.file1 where fn='foo1.csv' limit 10;

and see if it returns fine.

If this doesn't yield any clues then might be useful to share the HiveServer2 logs, explain plan.

Highlighted

Re: Cannot get a simple query on beeline to run using either TEZ or MR

Rising Star

@Deepesh

Following query returns values in both TEZ and MR mode

select split(ln,',')[0]as cid, split(ln,',')[1]as zip from utils.file1 where fn='foo1.csv' limit 1000;

Don't have an account?
Coming from Hortonworks? Activate your account here