Thank you for the explanation @Rajat_710. This helps. So once the logs from spool are processed they are moved to archive and hence, safe to be deleted, correct? Secondly, for SMM, logs are not going to HDFS at all. Is there a way to configure audit logs of SMM to go to HDFS like we are sending for other services? I did not see the configuration anywhere in SMM to enable this. Thanks snm1523 ... View more

Thank you for the response @RAGHUY. Would these be the only steps we need to perform or based on your experience, you have identified anything additional which is not mentioned in the documentation you shared. Thanks snm1523 ... View more

Hello @Rajat_710 , This is a last follow up query on this thread. Any clue how we configure Streams Messaging Manager server to send audit logs to HDFS and / or Solr (just like other services) and then they would get archived to /archive directory from where we will manually delete them? I am referring to logs that get stored under below location locally (not HDFS) /var/log/<service name>/audit/<HDFS or Solr>/spool/ Thanks snm1523 ... View more

Thank you for the reference, @Rajat_710 .  That link is referencing to a community post where someone has discussed about logs in HDFS. However, here I am more keen towards logs that are stored in local location and not getting deleted even after they are moved to HDFS. Since, you mentioned that this has to be manually deleted and Cloudera is currently working on implementing automatic purge of these logs from local, would it be possible to kindly share a reference article or a Cloudera blog post or a known issue reference where this has been mentioned / recorded. Thanks snm1523 ... View more

Thank you for the confirmation, @Rajat_710. Is there a Cloudera article / blog post / documentation informing this as a known issue or WIP that I can use as reference in our internal discussions. Will need something to propose and support manual deletion of HDFS and SOLR audit logs from local location. Thanks snm1523 ... View more

Hello @Rajat_710., Thank you for the response. Will definitely go through the article. However, have got a follow up question. I also noticed on master servers (local location configured using relevant properties), that the audit logs (HDFS and SOLR) are not getting purged automatically once they are sent to HDFS. Instead we have to run a cron job that triggers a shell script which clears the logs the from the location. If the job is stopped even for 15 mins, we will see a pile of logs at that location. Any suggestions if we have missed anything? Thanks snm1523 ... View more

@TommyH  Login to DB server where CM is storing metadata and then will need to delete the authentication backend entry. Please refer to below queries: select ATTR, VALUE from CONFIGS where ATTR = 'auth_backend_order'; delete from CONFIGS where ATTR = “auth_backend_order” and SERVICE_ID is null Hope this helps. Thanks snm1523 ... View more