Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nodemanager dont start and hive client is taking so much time to start.

Solved Go to solution
Highlighted

Nodemanager dont start and hive client is taking so much time to start.

I have a 4 node cluster with 3 nodemanagers. When i am trying to start nodemanagers they are going up and shutting down immediately. Only one node manager is working. When i am trying to start my hive client it is taking so much time to start.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

Mentor

@R c

First make a backup of yarn-site.xml then change it to mapreduce_shuffle and retest. Remember to restart the all the services on the node

<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property

To size better your memory have a look at HDP Memory Configuration Settings

View solution in original post

8 REPLIES 8

Re: Nodemanager dont start and hive client is taking so much time to start.

Contributor

when ever you initiate it will try to get min containers thats the reason it will be in hung up state.

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

so how to allocate the minimum container to overcome this issue

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

Mentor

@R c

This is a good starting point link

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

That did not help can you be more clear. My question is : I have 3 node managers in the cluster of which i am able to start only one. Remaining two node managers come up without an error and shut down immediately. I have followed all the memory allocations as per HDP

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

Mentor

@R c

what is the value yarn.nodemanager.aux-services in your yarn-site.xml file

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

mapreduce_shuffle,spark_shuffle

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

Mentor

@R c

First make a backup of yarn-site.xml then change it to mapreduce_shuffle and retest. Remember to restart the all the services on the node

<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property

To size better your memory have a look at HDP Memory Configuration Settings

View solution in original post

Highlighted

Re: Nodemanager dont start and hive client is taking so much time to start.

This Worked for me. thank you can you explain the reason for this which would really help.

Don't have an account?
Coming from Hortonworks? Activate your account here