question Nodemanager dont start and hive client is taking so much time to start. in Support Questions https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165636#M127998 <P>I have a 4 node cluster with 3 nodemanagers. When i am trying to start nodemanagers they are going up and shutting down immediately. Only one node manager is working. When i am trying to start my hive client it is taking so much time to start.</P> Fri, 04 Nov 2016 23:16:40 GMT ravichandrac65 2016-11-04T23:16:40Z Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165636#M127998 <P>I have a 4 node cluster with 3 nodemanagers. When i am trying to start nodemanagers they are going up and shutting down immediately. Only one node manager is working. When i am trying to start my hive client it is taking so much time to start.</P> Fri, 04 Nov 2016 23:16:40 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165636#M127998 ravichandrac65 2016-11-04T23:16:40Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165637#M127999 <P>when ever you initiate it will try to get min containers thats the reason it will be in hung up state.</P> Fri, 04 Nov 2016 23:33:53 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165637#M127999 Arun- 2016-11-04T23:33:53Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165638#M128000 <P>so how to allocate the minimum container to overcome this issue</P> Fri, 04 Nov 2016 23:41:46 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165638#M128000 ravichandrac65 2016-11-04T23:41:46Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165639#M128001 <P>@<A href="https://community.hortonworks.com/users/13157/ravichandrac65.html">R c</A></P><P></P><P>This is a good starting point <A target="_blank" href="http://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/">link</A></P> Fri, 04 Nov 2016 23:51:06 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165639#M128001 Shelton 2016-11-04T23:51:06Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165640#M128002 <P>That did not help can you be more clear. My question is : I have 3 node managers in the cluster of which i am able to start only one. Remaining two node managers come up without an error and shut down immediately. I have followed all the memory allocations as per HDP</P> Sat, 05 Nov 2016 01:56:44 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165640#M128002 ravichandrac65 2016-11-05T01:56:44Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165641#M128003 <P>@<A href="https://community.hortonworks.com/users/13157/ravichandrac65.html">R c</A></P><P>what is the value yarn.nodemanager.aux-services in your yarn-site.xml file</P> Tue, 08 Nov 2016 18:35:58 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165641#M128003 Shelton 2016-11-08T18:35:58Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165642#M128004 <P>mapreduce_shuffle,spark_shuffle</P> Wed, 09 Nov 2016 07:20:50 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165642#M128004 ravichandrac65 2016-11-09T07:20:50Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165643#M128005 <P> @<A href="https://community.hortonworks.com/users/13157/ravichandrac65.html">R c</A></P><P> First make a backup of yarn-site.xml then change it to mapreduce_shuffle and retest. Remember to restart the all the services on the node</P> <PRE>&lt;property&gt; &lt;name&gt;yarn.nodemanager.aux-services&lt;/name&gt; &lt;value&gt;mapreduce_shuffle&lt;/value&gt; &lt;/property</PRE><P>To size better your memory have a look at HDP Memory Configuration <A target="_blank" href="http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determine-hdp-memory-config.html">Settings</A></P> Wed, 09 Nov 2016 15:22:06 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165643#M128005 Shelton 2016-11-09T15:22:06Z Re: Nodemanager dont start and hive client is taking so much time to start. https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165644#M128006 <P>This Worked for me. thank you can you explain the reason for this which would really help.</P> Mon, 21 Nov 2016 09:41:32 GMT https://community.cloudera.com/t5/Support-Questions/Nodemanager-dont-start-and-hive-client-is-taking-so-much/m-p/165644#M128006 ravichandrac65 2016-11-21T09:41:32Z