Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

How to prevent nifi-app logs from filling my drive on my cluster

avatar
Explorer

Have been getting the below exception "ReplaceText[id=3fa43c98-5a5a-1c87-8e34-911a06de02aa] Processing failed: org.apache.nifi.processor.exception.ProcessException: IOException thrown from ReplaceText[id=3fa43c98-5a5a-1c87-8e34-911a06de02aa]: java.io.FileNotFoundException: /opt/nifi-1.17.0/content_repository/466/1666653401958-112082 (No space left on device) - Caused by: java.io.FileNotFoundException: /opt/nifi-1.17.0/content_repository/466/1666653401958-112082 (No space left on device)"

 

It seems like the disk is full which is not allowing the processors to update or modify the data. I notice that the logs directory on all the cluster have taken all the space. 

Each node has 64G of storage space and log directory has taken almost 55G of space. 

 

I recently notice my disk is getting full very quickly. I remove the logs and the repository and restart nifi and that seems to work but then again after a few hours it got filled up. I finally notice that the logs directly is taking all the space. How to prevent nifi-app logs from filling my drive.

1 REPLY 1

avatar
Master Collaborator

You can refer to this article and tune the logback.xml file to delete and rollover based log files based on you space constraints https://community.cloudera.com/t5/Community-Articles/Understanding-how-the-logback-xml-configuration...

 

If you found this response assisted with your issue, please take a moment to login and click on "Accept as Solution" below this post.

Thank you,

Chandan