I have small cluster with both HDP and HDF services... Given 24G of available disk space on every node, is there some rule to determine limit for the log sizes for for services? Do some of the service (HBase?) require more space than others?
You have to configure each service log4j configurations separately. For example Hbase log4j configurations can be configured with below configs.
hbase_log_maxbackupindex //defines how many back files should it retain
hbase.log.maxfilesize //defines what is the file size
hbase_security_log_maxbackupindex //defines how many back files should it retain
hbase_security_log_maxfilesize //defines what is the file size
You can follow the article as well https://community.hortonworks.com/articles/8882/how-to-control-size-of-log-files-for-various-hdp-c.h...