Member since
01-11-2019
105
Posts
10
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
789 | 07-01-2021 03:43 AM | |
906 | 03-15-2021 11:16 PM | |
766 | 02-22-2021 02:22 AM | |
974 | 11-20-2020 12:05 AM | |
2025 | 10-07-2020 01:00 AM |
07-01-2021
03:43 AM
Hello @Juandata You may get all the required information from the below links as @cjervis mentioned in his previous comment too. Please refer: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/hue.html https://docs.gethue.com/ Hope this helps! Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
06-14-2021
08:08 AM
Hello @Exor , The issue seems to be that the agent is not able to connect to archive.cloudera.com. Could you check or share what the failure is via the log files present under /tmp/scm_prepare_node.*/*
... View more
06-01-2021
01:36 AM
Hello @khanarshadazmat , We do not have a direct method to get the CM Server and Agent version like we have in java -version. However, you can follow some of the below workarounds to get the required result: 1_). using below command # hdfs version # hadoop version 2_). version info available at "/opt/cloudera/parcels/<CDH>/lib/hadoop/cloudera/cdh_version.properties" Let me know if this helps! Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-31-2021
12:42 AM
Hello @khanarshadazmat , You may get the role information using CM API for HDFS service. API: https://archive.cloudera.com/cm7/7.2.4/generic/jar/cm_api/apidocs/resource_RolesResource.html#resource_RolesResource_ClustersResourceV43_ServicesResourceV42_RolesResourceV41_readRoles_GET See the below example for a better understanding: • When I execute the above API, I would get the below details for HDFS service: "name" : "HDFS-1-NAMENODE-cb7144bc695976e34cfbaaf26c176d21",
"type" : "NAMENODE",
"serviceRef" : {
"clusterName" : "Cluster 1",
"serviceName" : "HDFS-1",
"serviceDisplayName" : "HDFS-1",
"serviceType" : "HDFS"
}, ...
"roleState" : "STARTED",
"healthSummary" : "GOOD",
"configStalenessStatus" : "FRESH",
"haStatus" : "STANDBY",
"maintenanceMode" : false,
"commissionState" : "COMMISSIONED",
"roleConfigGroupRef" : {
"roleConfigGroupName" : "HDFS-1-NAMENODE-BASE"
}, • and, for the second namenode, I'll get something as below: "name" : "HDFS-1-NAMENODE-b1d777dd6714507397225b07ea9057ce",
"type" : "NAMENODE",
"serviceRef" : {
"clusterName" : "Cluster 1",
"serviceName" : "HDFS-1",
"serviceDisplayName" : "HDFS-1",
"serviceType" : "HDFS"
}, ... "roleState" : "STARTED",
"healthSummary" : "GOOD",
"configStalenessStatus" : "FRESH",
"haStatus" : "ACTIVE",
"maintenanceMode" : false,
"commissionState" : "COMMISSIONED",
"roleConfigGroupRef" : {
"roleConfigGroupName" : "HDFS-1-NAMENODE-BASE"
},
"entityStatus" : "GOOD_HEALTH" • In both the above examples, check for the keyword "haStatus". The namenode with haStatus as Active would be your Active Namenode. Let me know if this helps. Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-27-2021
10:07 PM
Hello @jmbohl , @zuoseven , @napoleon , Please note that this is a known bug, but not yet fixed. Please check if the below properties in CM > HDFS > Configuration is set to an asterisk (*): -------------------------------- HDFS Proxy User Hosts HDFS Proxy User Groups Hue Proxy User Hosts Hue Proxy User Groups -------------------------------- If the above is set to asterisk, please let me know if the below workaround works: 1_). Create the user and group of the HDFS directory in HUE, then log in to HUE with the user of HDFS and then go to HUE to create an ACL for the HDFS directory 2_). Because there is a BUG in HUE for HDFS ACL, it is not recommended to use it this way. It is recommended that you still use the acl command line to create on HDFS. Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-19-2021
06:04 AM
2 Kudos
Hello @sweeny_here , You may skip the SSL check from the MySQL DB. To do so, below are the steps: 1. Stop the CM server 2. Set the property in MySQL config (my.cnf) file as below [mysql]
... ...
skip_ssl
...
... 3. Restart mysqld and CM Server. Also, please make sure to disable SSL in the CM db.properties file as below # you can set the &useSSL=false in the db.properties
com.cloudera.cmf.db.type=mysql
com.cloudera.cmf.orm.hibernate.connection.driver_class=com.mysql.jdbc.Driver
com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<mysql-host>/<database>?useUnicode=true&characterEncoding=UTF-8&useSSL=false
com.cloudera.cmf.db.name=<database>
com.cloudera.cmf.db.user=<CM-Mysql-user>
com.cloudera.cmf.db.setupType=EXTERNAL
com.cloudera.cmf.db.password=<password> Let me know if this helps! Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-17-2021
02:41 AM
Hello @AndrasV , You may get the details using the host API as below: https://archive.cloudera.com/cm6/6.2.0/generic/jar/cm_api/apidocs/resource_HostsResource.html#resource_HostsResource_HostsResourceV30_readHost_GET This would list down the roles that are installed/available on this particular host. To get the host Id, please use the below API: https://archive.cloudera.com/cm6/6.2.0/generic/jar/cm_api/apidocs/resource_HostsResource.html#resource_HostsResource_HostsResourceV30_readHosts_GET Let us know if this helps. Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
03-29-2021
12:35 AM
Hello @pauljoshiva, Please review the below post and let us know if that helps https://community.cloudera.com/t5/Support-Questions/How-to-remove-risk-disks-from-Hadoop-cluster/td-p/151752 Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
03-16-2021
03:19 AM
Hello @Amn_468, The property would include a double dash as " --backend_client_rpc_timeout_ms". You may also want to refer to the below official documentation: https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/impala-manage/topics/impala-timeout-thrift.html Kindly let me know if this helps! Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
03-15-2021
11:16 PM
1 Kudo
Hello @Amn_468 , You may update this value as below: • Cloudera Manager > Impala > Configuration > Update the value in " Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve)" • Click Save Changes and restart Impala. Let me know if this helps. Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
02-22-2021
03:07 AM
Hello @unSmallDonkey, Do you see any error messages in the Hue logs? This is usually seen due to the fact that the use_start_tls flag by default is set to true if the ldaps is not used. You may try to disable this property as below in the Hue safety valve and let us know if this resolves the issue: • Cloudera Manager > Hue > Configuation > Search for Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini • Add the below property: [desktop] [[ldap]] use_start_tls=false Cheers!
... View more
02-22-2021
02:22 AM
Hello @rajatsachan, Using the Delete Policy, you may set up any of the below options Delete Policy - Whether files that were deleted on the source should also be deleted from the destination directory. This policy also determines the handling of files in the destination location that are unrelated to the source. Options include: Keep Deleted Files - Retains the destination files even when they no longer exist at the source. (This is the default.). Delete to Trash - If the HDFS trash is enabled, files are moved to the trash folder. (Not supported when replicating to Amazon S3.) Delete Permanently - Uses the least amount of space; use with caution. Review the replication document for more details: https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_hdfs_replication.html Cheers!
... View more
12-20-2020
10:25 PM
@HDPass Could you check the below and share the output from the host where Cloudera Manager is installed: - # curl -u <username>:<password> http://<cloudera-manager-host>:7180 -v - # netsat -nap |grep 718 Also, share the screenshot of the error you see when trying to open the CM Web UI. Regards, Tarun
... View more
12-14-2020
02:01 AM
Hello @raghu9raghavend, You can use Sentry authorization for restricting access to UDF. Please refer to the below doc https://docs.cloudera.com/documentation/enterprise/latest/topics/impala_udf.html#udf_security Let us know if this helps! Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
12-14-2020
12:00 AM
Hello @prasanna06 In CDH 6.3.3 you may use the below-documented way to add the "Add-on service" https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_mc_addon_services.html#concept_kpt_spj_bn Let us know if this helps! Cheers! ----------------------------------- Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
11-20-2020
12:05 AM
Hello @HareeKrushnan I see that you are using a custom script to retrieve keytabs from the local filesystem. The script is failing as it is unable to find the required keytabs at the location cp: cannot stat ‘/etc/hadoop/conf/keytabs/spark_clouderadp02.ibm.cloud@IBM.CLOUD.keytab’: No such file or directory>> Please note that to use the custom script the KDC administrators should create the required principals and keytabs, and store them securely on the Cloudera Manager Server host. Please review the below document for more information on using a Custom Kerberos Keytab Retrieval Script https://docs.cloudera.com/documentation/enterprise/5-16-x/topics/sg_keytab_retrieval_script.html Let us know if this helps. Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
10-22-2020
12:20 AM
Hello @KrishnaSanka Can you cat / jbod5 /dfs/dn/current/VERSION on the problematic data node and verify the entry for 'datanodeUuid' with the other data nodes that are up and in healthy state? I believe it will be different than the 'datanodeUuid' you will find in the VERSION files for the other disks. Cheers!
... View more
10-21-2020
10:00 PM
Hello @Mentor You can use the service resource API to update (PUT) the service configuration. Please refer the below API doc https://archive.cloudera.com/cm7/7.0.3/generic/jar/cm_api/apidocs/resource_ServicesResource.html#resource_ServicesResource_ClustersResourceV40_ServicesResourceV33_updateServiceConfig_PUT Let me know if this helps! Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
10-07-2020
09:02 PM
Hello @bsivalingam83 You may navigate to NiFi configuration and search for ignore. To remove the “ java.arg.13=-XX:+UseG1GC ” you can add a property under the “ bootstrap.conf ignored properties ” section for “ java.arg.13 ". Kindly let me know if this helps. Br, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
10-07-2020
01:00 AM
@Deaks @HGeorge This issue can occur if you had some previous mount points and later if you have unmounted them. In some unusual scenarios, CM agent will still tries to grab the filesystem information of that mount point and fails. To temporarily suppress this error, update the /etc/cloudera-scm-agent/config.ini on each of the hosts affected to: 1. In the line that lists the nodev filesystems: # The list of non-device (nodev) filesystem types which will be monitored. monitored_nodev_filesystem_types=nfs,nfs4,tmpfs 2. Please change the uncommented line to read as : monitored_nodev_filesystem_types=nfs,nfs4 3. Restart the cloudera manager agent with: service cloudera-scm-agent restart Br, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
10-04-2020
08:56 PM
@Bibhusisa Could you please share the exact error you are getting and how you are trying to access the logs. A snapshot would really help us review the exact issue. Br, Tarun
... View more
10-01-2020
07:36 AM
1 Kudo
Hello @KarthiK439 , You can get the list of Yarn Applications using the below API https://archive.cloudera.com/cm7/7.0.3/generic/jar/cm_api/apidocs/resource_YarnApplicationsResource.html Let me know if this is what you are looking for. Br, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
09-18-2020
05:31 AM
1 Kudo
@Cristiano Rolling restart is valid only for below services: Flume HBase HDFS Kafka Key Trustee KMS Key Trustee Server MapReduce Oozie YARN ZooKeeper Since rolling restart is not available for Sentry, you are getting an error mentioning not a valid command.
... View more
09-18-2020
05:25 AM
@GauravCha Yes your query to get the cluster CPU usage is correct. Regarding the Data Granularity, in the chart builder you can select Show Additional Options next to 30d in the time frame. In the Additional Options you can select the granularity to be Hourly. Kindly let me know if this is what you are looking for.
... View more
06-05-2020
06:38 AM
1 Kudo
Hi @Jinmu You can use the below article to reset the admin password https://community.cloudera.com/t5/Support-Questions/reset-cdm-5-8-password/m-p/45843/highlight/true#M35380 I hope this helps! Regards, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
06-05-2020
06:35 AM
@Amn_468 On a high level below are the steps: Use Cloudera Manager to manage and distribute the krb5.conf that the CDH needs for requesting Kerberos tickets. Here are the recommended steps: Shutdown the CDH services Shutdown the Cloudera Manager Management services Walkthrough the steps for configuring direct to AD integration Regenerate all the principals Distribute the new krb5.conf (which has AD realm information) Start the Cloudera Manager Management services Start the CDH Services Also, review below docs: Enabling Kerberos Authentication for CDH https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_sg_intro_kerb.html?scroll=xd_583c10bfdbd326ba--6eed2fb8-14349d04bee--76dd I hope this helps. Thanks, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-29-2020
05:00 AM
@AK_ The target_cm_host should have the value as below. Could you please update this and let us know if this helps. TARGET_CM_HOST = " target.cm.cloudera.com " Also, please review the below documentation to automate BDR https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_howto_api.html#bdr_api_1 I hope this helps. Regards, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-29-2020
04:30 AM
Hello @AK_ You can use the below documentation to automate BDR replication. The documentation includes an example to demonstrate this https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_howto_api.html I hope this helps. Regards, Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-29-2020
04:26 AM
Hello @CloudEraLong I see that we don't have the following folder created: /var/www/html/cloudera-repos/gplextras6 Could you please try executing the steps mentioned for CDH 6.3.2 or lower here? You would have to update the wget command to include the correct version. Let me know if this helps. Tarun Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
05-29-2020
04:14 AM
@Mondi could you please let us know if you are getting any error while doing so? If yes, could you please share the error stack?
... View more