Member since
06-13-2021
485
Posts
13
Kudos Received
14
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
663 | 09-10-2024 05:04 AM | |
847 | 09-05-2024 07:42 AM | |
1476 | 08-02-2024 01:46 AM | |
1410 | 11-06-2023 06:49 AM | |
1372 | 09-21-2022 09:46 AM |
04-08-2025
01:34 AM
Introduction: In today's digital age, data security and compliance are paramount. Organizations handling sensitive information, especially in cloud environments, need robust tools to monitor and audit user activities. Cloudera Data Platform (CDP) offers a comprehensive auditing system to keep track of who's doing what in your environment. In this article, we'll delve into the world of audits in CDP Cloudera, explaining why they are essential and how to use them effectively. Why Audits Matter: Enhancing Security: Audits play a pivotal role in maintaining the security of your CDP Cloudera environment. By keeping a detailed log of user activities, audits help you identify suspicious or unauthorized actions promptly. Compliance Requirements: Many industries and organizations have stringent regulatory requirements. Audits help organizations adhere to these regulations by providing a clear record of data access and modifications. Investigation and Troubleshooting: When issues arise, audits serve as valuable tools for investigation and troubleshooting. You can trace user actions to identify the root cause of problems. Insight into User Behavior: Audits provide insights into user behavior and the usage patterns of your CDP Cloudera environment. This information can be used to optimize resource allocation and improve operational efficiency. How to Access Audits : - There are two primary methods to access audit information in CDP Cloudera: 1. CDP Management Console: The CDP Management Console provides a user-friendly interface for managing and accessing audit data. Navigate to the 'audits' section within the Management Console to retrieve audit events. 2. CDP Command Line Interface (CLI): If you prefer command-line access, you can use the CDP CLI. Use the following command to list audit events: cdp audit list-events --from-timestamp Start-Time --to-timestamp End-Time --event-source iam --event-name "InteractiveLogin" This command fetches audit events for the specified time range, event source, and event name. I have added the above example of the Stop Data Hub Clutser event. # cdp audit list-events --from-timestamp 2023-11-06T13:36:18.036Z --to-timestamp 2023-11-06T17:36:18.036Z --event-source datahub --event-name "stopCluster" --result-code "SUCCESS"
{
"auditEvents": [
{
"version": "1.1.0",
"id": "a0b57964-7bea-41d1-afc5-0fa7288d4868",
"eventSource": "datahub",
"eventName": "stopCluster",
"timestamp": 1699280001302,
"actorIdentity": {
"actorCrn": "crn:altus:iam:us-west-1:65e2e6e4-60dc-######:user:######"
},
"accountId": "65e2e6e4-60dc-4358-91a1-cbdc804f6303",
"requestId": "bfcb1a11-b0db-422c-af2e-b4db523a6681",
"resultCode": "SUCCESS",
"apiRequestEvent": {
"responseParameters": "{ }",
"mutating": false
}
}
]
} Let's break down the provided command and its output step by step: cdp audit list-events: This is the command that lists audit events in CDP Cloudera. --from-timestamp 2023-11-06T13:36:18.036Z: This is the start time for the audit event search. It specifies the date and time from which you want to retrieve audit events. --to-timestamp 2023-11-06T17:36:18.036Z: This is the end time for the audit event search. It specifies the date and time until which you want to retrieve audit events. --event-source datahub: This option filters the audit events by the event source. In this case, it filters for events originating from "datahub." --event-name "stopCluster": This option filters the audit events by the event name. It includes only events with the name "stopCluster." --result-code "SUCCESS": This option filters the audit events by the result code. It includes only events with the result code "SUCCESS." We can determine who performed the Data hub stop activity based on the actor identity provided in the output: actorIdentity: Information about the user or entity that triggered the event, including the user's Cloud Resource Name (CRN). In conclusion, audits in CDP Cloudera are essential for maintaining security, compliance, and operational efficiency. Whether you choose the Management Console or the CLI, accessing audit information is straightforward and invaluable for monitoring user activities within your environment.
... View more
Labels:
09-17-2024
03:03 AM
@Choolake, Did the response help resolve your query? If it did, kindly mark the relevant reply as the solution, as it will aid others in locating the answer more easily in the future.
... View more
09-10-2024
05:04 AM
1 Kudo
Hi @MaraWang Thanks for raising this query: Cloudera does not natively support JanusGraph or other third-party graph databases like Neo4j directly within its CDP (Cloudera Data Platform) ecosystem, and as you mentioned, GraphX and GraphFrames are also not supported in CDP 7.2.18. However, there are a few options you can consider for graph-based analytics or computations in the Cloudera environment but for that, I request you to raise a query to the account team. They are best suited to assist you in this. Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
... View more
08-22-2024
04:33 AM
1 Kudo
@bigdatacm May be the configuration for the Hive hook in Atlas is not properly set up. Ensure that the Atlas hook is correctly configured in the Hive configuration file (hive-site.xml). Check for any errors or warnings related to the hook configuration in the Atlas and Hive logs.
... View more
08-06-2024
03:21 PM
@ipson Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information @Scharan has requested? Thanks.
... View more
08-02-2024
03:04 AM
1 Kudo
Hello @hadoopranger , If you are using Cloudera Manager to manage your services, you can add new services using this document https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/managing-clusters/topics/cm-adding-a-service.html Also, you can use CM API to add the services to the cluster. https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/configuring-clusters/topics/cm-api-cluster-automation.html Hope this helps! Cheers!
... View more
11-09-2023
12:36 PM
@Amn_468 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more
09-27-2023
05:25 AM
1 Kudo
@TommyH Login to DB server where CM is storing metadata and then will need to delete the authentication backend entry. Please refer to below queries: select ATTR, VALUE from CONFIGS where ATTR = 'auth_backend_order'; delete from CONFIGS where ATTR = “auth_backend_order” and SERVICE_ID is null Hope this helps. Thanks snm1523
... View more
04-23-2023
11:10 PM
In addition as per your last comments, we can see you have a considerable amount of data under your /home directory. ex: 15G /home Could you please check if you can remove some data from it? Thanks
... View more
09-21-2022
09:46 AM
Hi @marcocharlie@marcocharlie I can see you or your team member created the support, we will mark this as solved. And the issue is resolved by Cloudera support.
... View more