Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error while running Hive queries

Error while running Hive queries

Hi,

 

I am running a query in Hive from Hue. When running a query "select * from abc", I get the results.

However when I run a query "select count(*) from abc", I get an error

"Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask"

It seems, it is not able to run MapReduce tasks.

 

Any settings which need to be examined for this?

 

 

1 REPLY 1

Re: Error while running Hive queries

On further analysis, we found that the error actually related to memory -

 

InvalidResourceRequestException Invalid resource request,
requested memory < 0, or requested memory > max configured,
requestedMemory=5120, maxMemory=1024

 

We looked through various sites and changed the Yarn configuration at 2 places - 

 

Cloudera Manager --> Yarn --> Configuration

1) Search for "yarn-site"

At the Yarn Service Advanced Configuration Snippet, add a safety valve as follows

<property>
<name>yarn.scheduler.maximum-allocation-mb</name>
<value>5120</value>
</property>

 

2) Search for "yarn_nodemanager_resource"

Change Container Memory at both places to default value of 8 GB

 

We restarted the cluster and deployed the new configuration and Hive queries started running from command line interface.

 

However, I am unable to run them through Hue. Get an error "Unmanageable server error occured: undefined". Not sure if the above changes are the cause of this error.

 

Any inputs?

 

Don't have an account?
Coming from Hortonworks? Activate your account here