How to delete log folder faster having files lots of file and heavy log folder

vpemawat — Tue, 18 Oct 2016 17:43:17 GMT

Problem : Deletion of log folder with below details

Log size is around 10gb

No . of files around 9k files.

Simple rm -rf log folder doesn't works well.

Re: How to delete log folder faster having files lots of file and heavy log folder

hduraiswamy — Tue, 18 Oct 2016 22:36:40 GMT

If you are not using log4j: If you are looking to delete the files for good then there is not many options available other than rm -rf; however there are few tweaks that you can do to make it faster

you can perhaps run multiple rm scripts in parallel (multiple threads)
In order to do this, you should be able to logically separate the log files either by folder or name format
Once you have done that, you can run multiple rm commands in background like something below

nohup rm -fr app1-2016* > /tmp/nohup.out 2>&1 &
nohup rm -fr app1-2015* > /tmp/nohup.out 2>&1 &

If using log4j: You should probably be 'DailyRollingFileAppender" with 'maxBackupIndex' - this will essentially limit the max file size of your log and then purge the older contents. More details here: http://www.codeproject.com/Articles/81462/DailyRollingFileAppender-with-maxBackupIndex

Outside of this, you should consider the below 2 things for future use cases

Organize the logs by folder (normally broken down like /logs/appname/yyyy/mm/dd/hh/<log files>
Have a mechanism that will either delete the old log files, or archive it to a different log archive server

Hopefully this helps. If it does, please 'accept' and 'upvote' the answer. Thank you!!

question Re: How to delete log folder faster having files lots of file and heavy log folder in Archives of Support Questions (Read Only)

How to delete log folder faster having files lots of file and heavy log folder

Re: How to delete log folder faster having files lots of file and heavy log folder