Created on 04-11-2024 04:02 AM - edited 04-11-2024 04:03 AM
Hello All,
On CDP PB, like we send ranger audit logs of services thats support Ranger plugin to HDFS, can we also send logs of Stream Messaging Manager service to HDFS?
I tried to look for config to achieve this, however, I could find only 2 configs (listed below) that allow us to configure the local path. However, there was nothing found to send these logs to HDFS.
Ranger Streams Messaging Manager Plugin Audit Hdfs Spool Directory Path
Ranger Streams Messaging Manager Plugin Audit Solr Spool Directory Path
Any help / guidance will be highly appreciated.
Thanks
snm1523
Created 04-21-2024 11:25 PM
Created 05-16-2024 02:35 AM
Thank you for the explanation @Rajat_710. This helps.
So once the logs from spool are processed they are moved to archive and hence, safe to be deleted, correct?
Secondly, for SMM, logs are not going to HDFS at all. Is there a way to configure audit logs of SMM to go to HDFS like we are sending for other services? I did not see the configuration anywhere in SMM to enable this.
Thanks
snm1523
Created 07-26-2024 05:49 AM
no, you cannot configure audit logs of SMM to go to HDFS