Is there a log management strategy that can be used in HDP?

[#1]

I am trying to install a new cluster, is there a standard HDP log management strategy?

[#2]

@Sreelakshmi Lingala Yes, please refer below links for more about them.

https://community.hortonworks.com/articles/118786/log4j-settings-for-hdp-services.html

https://community.hortonworks.com/articles/8882/how-to-control-size-of-log-files-for-various-hdp-c.h...

Let me know if this helps.

[#3 · Accepted solution]

@Sreelakshmi Lingala

Although it depends on the requirements of the project or implementation the following link provides details of log size management

https://community.hortonworks.com/articles/8882/how-to-control-size-of-log-files-for-various-hdp-c.h...

Also OS level tools would be important from managing disk space compressing the log files.

Also check the level of logging (WARN,DEBUG ....) enabled in the various log components in HDP which would avoid unexpected results.

Along with this one needs to make sure Ambari Logs usually /var/log also does not spiral out of control.