Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Where can i find the spark logs on local disk?
Labels:
- Labels:
-
Apache Hadoop
-
Apache YARN
-
HDFS
Explorer
Created ‎05-09-2021 09:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey I need to find the yarn logs on the local disk. Where I can find the logs ? Also can I see the log id manually in log files?
1 REPLY 1
Master Collaborator
Created ‎05-19-2021 08:07 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
Not sure this info is available.
1. you can check the yarn application logs in hdfs under /tmp/logs you can find this exact path by going to Cloudera manager -> Yarn -> Configuration -> yarn.nodemanager.remote-app-log-dir
2. If you have an application id you can just collect the logs manually with below command:
## yarn logs -applicationId <application ID> > applogs.txt
