question Nodemanager shutsdown soon after start - where to find the logs for shutdown? in Support Questions

Nodemanager shutsdown soon after start - where to find the logs for shutdown?

pmj — Fri, 16 Sep 2022 12:15:42 GMT

Hi, one of my nodemanager shuts down because my /var directory was full. I cleared it and restarted it but it is still shutting down. I dont seem to find anywhere why my nodemanager is shutting down soon after restart... i went to the node that has issue at /var/log/hadoop-yarn/yarnyarn-yarn-nodemanager-xxxx.log but nothing seems to be there. Where can i look for the logs?

Re: Nodemanager shutsdown soon after start - where to find the logs for shutdown?

pmj — Mon, 18 Sep 2017 22:34:02 GMT

i stil dint find logs for start and stopping nodemanager but my nodemanager is running now after i restarted yarn components.

Re: Nodemanager shutsdown soon after start - where to find the logs for shutdown?

ssathish — Tue, 19 Sep 2017 01:28:18 GMT

Hi @PJ

All services logs can be found at the location mentioned in the yarn-env.sh (can be found under Hadoop Conf files, usually /etc/hadoop/conf/) on the respective nodes.

Example yarn-env.sh

export YARN_LOG_DIR=/grid/0/log/yarn/

Re: Nodemanager shutsdown soon after start - where to find the logs for shutdown?

ssathish — Tue, 19 Sep 2017 01:28:59 GMT

Hi @PJ

All services logs can be found at the location mentioned in the yarn-env.sh (can be found under Hadoop Conf files, usually /etc/hadoop/conf/) on the respective nodes.

Example yarn-env.sh

export YARN_LOG_DIR=/grid/0/log/yarn/

Re: Nodemanager shutsdown soon after start - where to find the logs for shutdown?

ramya — Tue, 19 Sep 2017 02:46:17 GMT

@PJ You can also look at the .out files which are present in the same yarn log dir location. Alternatively, you can launch the process in the foreground using "yarn nodemanager" CLI to see why the process is shutting down immediately.