Member since
05-07-2020
5
Posts
0
Kudos Received
0
Solutions
05-20-2020
04:11 AM
Hi @GangWar , I upgraded my cloudera Enterprise trail to cloudera Enterprise. But still I am facing the same issue. Facing this issue for long time. Whereas file upload by command(hadoop distcp) works fine in the environment. Thanks
... View more
05-17-2020
11:57 PM
Hi, Please suggest how to do replication schedule with python mode cm_client. I tried with cm_api code as below hdfs = api_root . get_cluster ( CLUSTER_NAME ). get_service ( HDFS_NAME ) hdfs_cloud_args = ApiHdfsCloudReplicationArguments ( None ) hdfs_cloud_args . sourceService = ApiServiceRef ( None , peerName = None , clusterName = CLUSTER_NAME , serviceName = HDFS_NAME ) hdfs_cloud_args . sourcePath = '/src/path' hdfs_cloud_args . destinationPath = 's3a://bucket/target/path/' hdfs_cloud_args . destinationAccount = CLOUD_ACCOUNT
hdfs_cloud_args . mapreduceServiceName = YARN_SERVICE schedule = hdfs . create_replication_schedule ( start , end , "DAY" , 1 , True , hdfs_args )
I am using python 2.7.5. This code is not working and shows no attribute errors. Thanks in advance
... View more
Labels:
05-14-2020
04:03 AM
from cm_api.api_client import ApiResource from cm_api.endpoints.types import * TARGET_CM_HOST = "http://10.xxx.xx.xx:7180/" api_root = ApiResource(TARGET_CM_HOST, username="admin", password="auth") cm = api_root.get_cloudera_manager() ACCESS_KEY=<accessKey> SECRET_KEY=<SecretKey> TYPE_NAME = 'AWS_ACCESS_KEY_AUTH' account_configs ={'aws_access_key': ACCESS_KEY,'aws_secret_key': SECRET_KEY} cm.api.create_external_account("cloudAccount1","cloudAccount1",TYPE_NAME,account_configs=account_configs) This program return AttributeError: 'ClouderaManager' object has no attribute 'api' Please suggest the version which contains attribute 'api' in it.
... View more
Labels:
05-11-2020
02:25 AM
Hi @GangWar, The cloudera enterprise trial version is licensed. I can able to get the license key from administration>license and Backup option is enabled in cloudera(Backup option is not enabled in cloudera express). The url you provided also not suggesting that enterprise trial version doesn't support BDR. Can you confirm cloudera Enterprise trail does not support BDR?
... View more
05-07-2020
10:17 PM
Hi, I created a BDR replication schedule to backup data from S3 to HDFS and vice versa. The replication schedule fails with error Message HDFS replication command failed. Setup Error org.apache.hadoop.fs.s3a.AWSClientIOException: doesBucketExist on <BucketName>: com.amazonaws.SdkClientException: Unable to execute HTTP request: <BucketName>.s3-ap-south-1.amazonaws.com: Name or service not known: Unable to execute HTTP request: <BucketName>.s3-ap-south-1.amazonaws.com: Name or service not known I am using cloudera 5.16.1 Enterprise Trial version. The cloudera is running from a linux server which has network restrictions. As I am new to cloudera I am missing something basic here. Thanks in advance
... View more
Labels: