About lwang

lwang · ‎01-30-2020

Hi @sergei_P , It is ok to use CM5.8.5 with CDH5.4.4 because CM version is higher. The Cloudera Manager minor version must always be equal to or greater than the CDH minor version. Older versions of Cloudera Manager might not support features in newer versions of CDH. See this doc: https://docs.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#cm_cdh_compatibility As for the issue you are experiencing, I wonder what is the value for this file? /var/kerberos/krb5kdc/kadm5.acl Try to use kadmin to list all the principals to confirm whether cloudera-scm/admin@EXAMPLE.COM is correctly set up. Thanks, Li

lwang · ‎01-29-2020

Hi @sergei_P , What is your Cloudera Manager version? Is it same as CDH version? Did you use the wizard to enable Kerberos? If so, you can read this doc section "KRB5 configuration" for more information: https://docs.cloudera.com/documentation/enterprise/5-4-x/topics/cm_sg_s4_kerb_wizard.html#concept_irl_x5y_l4 Manage krb5.conf through Cloudera Manager allows you to choose whether Cloudera Manager should deploy the krb5.conf on your cluster or not. If left unchecked, you must ensure that the krb5.conf is deployed on all hosts in the cluster, including the Cloudera Manager Server's host. So depends if you choose above setting, you need to either check whether you configure the "Kerberos Security Realm" correctly from UI or you need to check whether /etc/krb5.conf are correctly configured on all hosts manually. Thanks and hope this helps, Li

lwang · ‎01-27-2020

Hi @kiranpune , Based on step 7 below, the answer is yes that you need to add the user in OS level. https://docs.cloudera.com/cloudera-manager/7.0.3/security-kerberos-authentication/topics/cm-security-kerberos-enabling-step7-prepare-cluster.html Here: Make sure all hosts in the cluster have a Linux user account with the same name as the first component of that user's principal name. For example, the Linux account joe should exist on every box if the user's principal name is joe@YOUR-REALM.COM. You can use LDAP for this step if it is available in your organization. Thanks, Li

lwang · ‎01-27-2020

Hi @NIPB , Are you using Impala? What product you use to connect to Impala via ODBC? You may want to check below few information to find out what caused the issue: 1. The connection string for the ODBC driver 2. The query for this error log 3. The profile of this query 4. The full ODBC driver log Thanks, Li

lwang · ‎01-23-2020

@kiranpune , What is your CM version? Here is the latest documentation on Cloudera website. The step 3, 6 and 7 maybe the answer to your question. https://docs.cloudera.com/cloudera-manager/7.0.3/security-kerberos-authentication/topics/cm-security-kerberos-enabling-step6-user-principals.html Thanks, Li

lwang · ‎01-22-2020

@saihadoop , If you can isolate the issue to a particular day, you may want to check whether there are any cron jobs running on that day. Thanks, Li

lwang · ‎01-16-2020

Hi @saihadoop , The error "java.lang.OutOfMemoryError: unable to create new native thread" usually indicates that the OS could not meet the new thread creation request from the process (in your case is YARN). You may want to check if there was any spikes in the load on the nodes. Please check /etc/security/limits.conf file to find out what is the configured maximum limit of nproc and nofile and whether the value is sufficient to handle the load for the service user. If the value is too low, you can try to edit the /etc/security/limits.conf on all nodes in the cluster, and add the following at the bottom of the file: user soft nproc 30000 user hard nproc 30000 user hard nofile 30000 user soft nofile 30000 Where the "user" is the specific user running the YARN job. After that, save the file and try to run the job again. Thanks and hope this helps, Li

lwang · ‎01-08-2020

Hi @vsrikanth9 , Is this a new installation? Could you please provide the repo file from /etc/yum.repos.d/ and the complete log? Thanks, Li

lwang · ‎12-20-2019

Greetings! We are pleased to announce General Availability of HDP-3.1.5.0 and AMBARI-2.7.5.0! With this release HDP is supporting single catalog for Hive/Spark and Hive table-level replication. To keep up with the increased customer interest, we delivered HBase 2.1.6 and GCS Connector 1.9.17 as well. We have also delivered nearly 200 fixes to increase stability, usability, supportability and performance, enhance security and improve the overall customer experience with HDP and Ambari. A big kudos and a mountain of gratitude to each and every member of the sustaining, development, quality, release engineering, documentation, biz ops and legal team, to deliver this release with such high quality. Documentation Download Thank you all again for your continued support and commitment on this journey! As always, we welcome your feedback. Please send your comments and suggestions to the user group through our community forums. You can also report issues through our external Jira projects on issues.cloudera.org.

lwang · ‎12-20-2019

Hi @GrahamB , You may want to download the client configuration file for HDFS service to confirm whether your changes are applied: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_mc_client_config.html However, my point is whether setting those two values are the right methods for the testing scenarios you are trying to achieve. Thanks, Li

Online	Offline
Last Visited	‎05-05-2020 02:22 PM

Member Since	‎05-27-2014 10:28 AM
Last Visited	‎05-05-2020 02:22 PM
Posts	1,499
Kudos received	75

Cloudera Community

Re: Error when Preparing the Cloudera Manager Serv...

Re: Authentication methods for Cloudera Express 6....

Re: HUE UI cache's username and pasword

Re: Solr through Hue is throwing 403 request excep...

Re: cloudera scm server start issues - java

Re: Generating kerberos credentials fails in CDH 5...

Re: Generating kerberos credentials fails in CDH 5...

Re: Adding User in kerberised Cluster

Re: ODBC driver error 10210 attribute identifier i...

Re: Adding User in kerberised Cluster

Re: yarn out of memory issue

Re: yarn out of memory issue

Re: Failed to install cloudera-manager-agent packa...

[ANNOUNCE] HDP 3.1.5 / Ambari 2.7.5 is now General...

Re: how to set dfs.namenode.delegation.token.renew...