No, the cdpcli does not store any file in a temp location. it is the data lake backup that stores the temp file on the master node, you can try the following command:   cdp datalake backup-datalake --datalake-name dl-bakup --backup-name test-backup --skip-ranger-hms-metadata --skip-atlas-metadata --skip-ranger-audits --backup-location s3a://bucket-name/backup-archive  Please refer to the below official doc for data lake backup: Configuring and running Data Lake backups    Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hi @Christ    If your issue has been resolved, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. ... View more

@pandav Welcome to Cloudera Community, I can understand you are facing issues while taking the Data lake backup.   Could you please provide the output of the following command: # cdp datalake list-datalake-backups --datalake-name dl-name # df -kha   what is your CDP runtime version, because we have seen this in the past whenever we tried to take Data lake back up, it will backup ranger-HMS-metadata and ranger-audit. The temp file will be written to the master node before moving to S3. The metadata is too big that fills up the root file system on the master node.   You can contact Cloudera support also on this.     Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hello @grlzz,    We already have a feature related to this, please find the below feature improvement id: 1- DSE-13091 You can contact the account team if you would like to get updates on the JIRA.   Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hi @Christ,   Thanks for being a part of the Cloudera community,   CDP Public Cloud Data Warehouse  CDP Private Cloud Data Warehouse  You can leverage the above options provided by Cloudera for the Public and Private clouds.   Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. ... View more

Hello Lakshmi   - The role you are mapping to the user in the IDBroker mapping section has the right S3 bucket specified? Or are you using the same bucket created during the DataLake deployment? - Can you also make sure that Spark is configured to point to the S3 bucket [1]. For Spark, it is required to define the S3 bucket name in the following property "spark.yarn.access.hadoopFileSystems". Example: If using a DataHub cluster, Access to the DH in the Management Console > CM-UI > Clusters > Spark > Configurations > Create a file names "spark-defaults.conf" or update the existing file with the property: spark.yarn.access.hadoopFileSystems=s3a://bucket_name or  DL--Manage Access-- IDBroker Mappings -- edit -- It was given the Data Access Role. DH --Manage Access-- Assigned your self required roles   ... View more

To get the number of vcores and memory used for a particular queue in the cluster You can get this information in the cluster utilization report, please go through the below doc for more information: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/admin_cluster_util_report.html Also, if you want to see the resources used for each application, please go through the below KB article: https://my.cloudera.com/knowledge/How-to-calculate-memory-and-v-core-utilization-for-each-of-the?id=... another option is Using yarn application -status command, you can get the Aggregate Resource Allocation for an application. For e.g.  yarn application -status application_ID (for one of completed applications), one of the rows returned is: Aggregate Resource Allocation : 46641 MB-seconds, 37 vcore-seconds This gives an aggregate memory and CPU allocations in seconds. https://my.cloudera.com/knowledge/How-to-calculate-memory-and-v-core-utilization-for-each-of-the?id=... ... View more

Hello @shadma-1    Just wanted to check if you have any further queries related to the replication manager.   Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button 🙂 ... View more