Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Yarn logs to hdfs

Highlighted

Yarn logs to hdfs

New Contributor

Hi!

 

I am wondering.. can you store all yarn logs to hdfs directly and not to a local server folder?

2 REPLIES 2

Re: Yarn logs to hdfs

Explorer

yarn logs will be stored in local not hdfs

Re: Yarn logs to hdfs

Master Guru
With log aggregation turned on, logs from containers in YARN typically get uploaded to HDFS at the end of the container's life, and then deleted from the local disks.

Could you expand on what lead you to this question/what you are observing and are looking to change?