Where can i find the spark logs on local disk?

rashm — Mon, 10 May 2021 04:19:03 GMT

Hey I need to find the yarn logs on the local disk. Where I can find the logs ? Also can I see the log id manually in log files?

Re: Where can i find the spark logs on local disk?

ChethanYM — Thu, 20 May 2021 03:07:51 GMT

Hi,

Not sure this info is available.

1. you can check the yarn application logs in hdfs under /tmp/logs you can find this exact path by going to Cloudera manager -> Yarn -> Configuration -> yarn.nodemanager.remote-app-log-dir

2. If you have an application id you can just collect the logs manually with below command:

## yarn logs -applicationId <application ID> > applogs.txt

question Where can i find the spark logs on local disk? in Support Questions

Where can i find the spark logs on local disk?

Re: Where can i find the spark logs on local disk?