Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Where can i find the spark logs on local disk?

avatar
Explorer

Hey I need to find the yarn logs on the local disk. Where I can find the logs ? Also can I see the log id manually in log files?

1 REPLY 1

avatar
Super Collaborator

Hi,

Not sure this info is available.

1. you can check the yarn application logs in hdfs under /tmp/logs you can find this exact path by going to Cloudera manager -> Yarn -> Configuration -> yarn.nodemanager.remote-app-log-dir

 

2. If you have an application id you can just collect the logs manually with below command:

   ##  yarn logs -applicationId <application ID>  > applogs.txt