Hello Lakshmi   - The role you are mapping to the user in the IDBroker mapping section has the right S3 bucket specified? Or are you using the same bucket created during the DataLake deployment? - Can you also make sure that Spark is configured to point to the S3 bucket [1]. For Spark, it is required to define the S3 bucket name in the following property "spark.yarn.access.hadoopFileSystems". Example: If using a DataHub cluster, Access to the DH in the Management Console > CM-UI > Clusters > Spark > Configurations > Create a file names "spark-defaults.conf" or update the existing file with the property: spark.yarn.access.hadoopFileSystems=s3a://bucket_name or  DL--Manage Access-- IDBroker Mappings -- edit -- It was given the Data Access Role. DH --Manage Access-- Assigned your self required roles   ... View more

To get the number of vcores and memory used for a particular queue in the cluster You can get this information in the cluster utilization report, please go through the below doc for more information: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/admin_cluster_util_report.html Also, if you want to see the resources used for each application, please go through the below KB article: https://my.cloudera.com/knowledge/How-to-calculate-memory-and-v-core-utilization-for-each-of-the?id=... another option is Using   yarn application -status   command, you can get the   Aggregate Resource Allocation   for an application. For e.g.    yarn application -status application_ID   (for one of completed applications), one of the rows returned is: Aggregate Resource Allocation : 46641 MB-seconds, 37 vcore-seconds This gives an aggregate memory and CPU allocations in seconds. https://my.cloudera.com/knowledge/How-to-calculate-memory-and-v-core-utilization-for-each-of-the?id=... ... View more

Hello @shadma-1    Just wanted to check if you have any further queries related to the replication manager.   Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button 🙂 ... View more

Hello @Juanes ,   Could you please check the  ksck report ksck report from kudu, Please if you have any unhealthy tables also verify the replicas as well. Please refer doc[1]   doc[1]:  https://kudu.apache.org/docs/administration.html#tablet_majority_down_recovery Thanks,  ... View more

Hello @shadma-1    We have one experience in CDP  to achieve this named as Replication Manager, with the help of it you can migrate your HDFS/HIVE/HBase data to S3 or Azure.   Please refer to the below official link for your reference, also if have any difficulties you can reach out to the support team as well.   1- Cloudera Replication Manager  2- Introduction to Replication Manager    Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hello @drgenious  Please  reach out to  certification@cloudera.com.   Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hello @grlzz,   You can refer to the below doc[1] to understand the CDP user accounts. Please have a look into it and let us know if you have further queries.   doc[1]: Understanding CDP user accounts   Thanks.     ... View more

Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hello Zhangliang, For the more efficient tuning of the content repository archive you can use these pages (you might have already known them): https://community.cloudera.com/t5/Community-Articles/Understanding-how-NiFi-s-Content-Repository-Archiving-works/ta-p/249418 https://nifi.apache.org/docs/nifi-docs/html/nifi-in-depth.html#deeper-view-provenance-log-files also  1] - Add the following property from Ambari under nifi.properties section to a value of 75% nifi.content.repository.archive.backpressure.percentage to 75% 2] Increase the disk space. ... View more

 we have a couple of options here: 1- Basically we have a dedicated person assigned from the Cloudera Account team. 2- You can raise a support case from the Cloudera support portal and the support team will help you to get this done.   I hope this answers your queries 🙂   ... View more

Hello CDPTester,   Welcome to CDP :).    Could you please update us this is the Data lake or the Datahub? In legacy CDH we were having Administrator access on CM through which we were able to move the roles.   But in CDP we have removed the full admin access for users. You can create your own custom template for Data hubs as per the requirement.    Also, We have resize option through which you can the required nodes to the cluster.   Let us know if you have any further queries. ... View more

- I would request you to please check with the Account team for queries like this. - This type of request is generally taken care of by the account team, not by the support team.   Please l et me know if you have any further queries. ... View more

Could you please attach the cm-server and cm-agent logs to it. ... View more

This could the possible solution, Please share the CM server logs 1) log into CM server host and take a backup file of /etc/default/cloudera-scm-server to a backup location 2) Open /etc/default/cloudera-scm-server file and add the following to the CMF_JAVA_OPTS: -Dlog4j.configurationFile=file:/etc/cloudera-scm-server/log4j2.properties With the above configuration, the file looks like this: [...] export CMF_JAVA_OPTS="[...existing...javaoptions] -Dlog4j.configurationFile=file:/etc/cloudera-scm-server/log4j2.properties" [...] 3) Create the /etc/cloudera-scm-server/log4j2.properties file. #chmod 644 /etc/cloudera-scm-server/log4j2.properties 4) We noticed some issues with the ODBC connector: #ls -ltr /usr/share/java/mysql-connector-java.jar *Not existing file 6) We copied the ODBC from a different environment. Cloudera Manager is able to start, but it is failing to connect to DB, We granted more connections in the db.properties file: #vi /etc/cloudera-scm-server/db.properties and add the below line in this file: > com.cloudera.cmf.orm.hibernate.c3p0.max_statements=0 < 7) After the restart, the CM server started successfully ... View more

Basically in CDP public cloud, FreeIPA acts a KDC server So when the cluster is created, CM server will create necessary Kerberos SP’s in FreeIPA database and it is handled automatically, Similarly when a user is synced to FreeIPA, a kerberos principal will be created in FreeIPA ... View more