Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on
04-11-2024
04:02 AM
- last edited on
04-20-2026
11:32 PM
by
GrazittiAPI
Hello All,
On CDP PB, like we send ranger audit logs of services thats support Ranger plugin to HDFS, can we also send logs of Stream Messaging Manager service to HDFS?
I tried to look for config to achieve this, however, I could find only 2 configs (listed below) that allow us to configure the local path. However, there was nothing found to send these logs to HDFS.
Ranger Streams Messaging Manager Plugin Audit Hdfs Spool Directory Path
Ranger Streams Messaging Manager Plugin Audit Solr Spool Directory Path
Any help / guidance will be highly appreciated.
Thanks
snm1523
Created 04-21-2024 11:25 PM
Created 05-16-2024 02:35 AM
Thank you for the explanation @Rajat_710. This helps.
So once the logs from spool are processed they are moved to archive and hence, safe to be deleted, correct?
Secondly, for SMM, logs are not going to HDFS at all. Is there a way to configure audit logs of SMM to go to HDFS like we are sending for other services? I did not see the configuration anywhere in SMM to enable this.
Thanks
snm1523
Created 07-26-2024 05:49 AM
no, you cannot configure audit logs of SMM to go to HDFS