Member since
10-29-2015
123
Posts
31
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
759 | 06-27-2024 02:42 AM | |
2282 | 06-24-2022 09:06 AM | |
3656 | 01-19-2021 06:56 AM | |
55541 | 01-18-2016 06:59 PM |
05-01-2024
03:58 AM
1 Kudo
Hello @Rajat_710 , This is a last follow up query on this thread. Any clue how we configure Streams Messaging Manager server to send audit logs to HDFS and / or Solr (just like other services) and then they would get archived to /archive directory from where we will manually delete them? I am referring to logs that get stored under below location locally (not HDFS) /var/log/<service name>/audit/<HDFS or Solr>/spool/ Thanks snm1523
... View more
04-22-2024
02:49 AM
1 Kudo
Thank you for the reference, @Rajat_710 . That link is referencing to a community post where someone has discussed about logs in HDFS. However, here I am more keen towards logs that are stored in local location and not getting deleted even after they are moved to HDFS. Since, you mentioned that this has to be manually deleted and Cloudera is currently working on implementing automatic purge of these logs from local, would it be possible to kindly share a reference article or a Cloudera blog post or a known issue reference where this has been mentioned / recorded. Thanks snm1523
... View more
04-17-2024
04:12 AM
1 Kudo
Thank you for the confirmation, @Rajat_710. Is there a Cloudera article / blog post / documentation informing this as a known issue or WIP that I can use as reference in our internal discussions. Will need something to propose and support manual deletion of HDFS and SOLR audit logs from local location. Thanks snm1523
... View more
04-17-2024
01:30 AM
1 Kudo
Hello @Rajat_710., Thank you for the response. Will definitely go through the article. However, have got a follow up question. I also noticed on master servers (local location configured using relevant properties), that the audit logs (HDFS and SOLR) are not getting purged automatically once they are sent to HDFS. Instead we have to run a cron job that triggers a shell script which clears the logs the from the location. If the job is stopped even for 15 mins, we will see a pile of logs at that location. Any suggestions if we have missed anything? Thanks snm1523
... View more
04-11-2024
04:02 AM
1 Kudo
Hello All, On CDP PB, like we send ranger audit logs of services thats support Ranger plugin to HDFS, can we also send logs of Stream Messaging Manager service to HDFS? I tried to look for config to achieve this, however, I could find only 2 configs (listed below) that allow us to configure the local path. However, there was nothing found to send these logs to HDFS. Ranger Streams Messaging Manager Plugin Audit Hdfs Spool Directory Path Ranger Streams Messaging Manager Plugin Audit Solr Spool Directory Path Any help / guidance will be highly appreciated. Thanks snm1523
... View more
09-27-2023
05:25 AM
1 Kudo
@TommyH Login to DB server where CM is storing metadata and then will need to delete the authentication backend entry. Please refer to below queries: select ATTR, VALUE from CONFIGS where ATTR = 'auth_backend_order'; delete from CONFIGS where ATTR = “auth_backend_order” and SERVICE_ID is null Hope this helps. Thanks snm1523
... View more
07-12-2023
02:05 AM
Hello All, Just checking if anyone is aware or can guide me to a documentation that would provide details of comparison between CDP Private Cloud vs HPE Ezmeral Data Fabric Platform. I have read somewhere that HP took over MapR and then formed HPE Ezmeral. However, can't find what are the differences. Please advise. Thanks snm1523
... View more
Labels:
06-16-2023
11:11 AM
Hello, We are on CDP 7.1.7 SP1 and as per my understanding when DistCp is executed with below parameters, it does the following: 1. update: this will update the files in destination that have got modified at source 2. delete: this will delete the files in destination that exist in destination but not in source. Apart feom above, it will copy over any new files at source that do not exist in destination. While copy and update is happening, it does not delete the files instead duplicates them and hence, the data count at destination is double than the source. Kindly help urgently as we are at the verge of initiating heavy data copy. Thanks snm1523
... View more
Labels:
06-09-2023
05:57 AM
Hello, How do we fetch the number of columns each table has in each DB from HMS DB? I have an urgent need to do a comparison for the number of columns each table has in each DB between 2 clusters. Doing that manually is practically impossible. Kindly help Thanks snm1523
... View more
Labels: