About dgiri_india1989

dgiri_india1989 · ‎01-30-2018

Thanks @Karthik Palanisamy for sharing this article. I have done the same activity without initializing shared edits or stopping the entire HDFS service. Below are the steps which I have followed. Can you please elaborate why we need to re-initialize the shared edits and correct me if the steps I have followed are not appropriate one. 1. Change the settings in Ambari for journal node edits directory(dfs.journalnode.edits.dir) from /hadoop/hdfs/journal/ to /data/1/journal/ 2. Don't restart any services immediately. 3. Stop the journal node on NODE1. a. SSH to NODE1 b. sudo mkdir -p /data/1/journal c. sudo chown hdfs:hadoop /data/1/journal d. sudo rsync -ahvAX /hadoop/hdfs/journal/* /data/1/journal/ Start the journal node on NODE1 4. Repeat step 3 for remaining two journal nodes NODE2 and NODE3. 5. Restart the required services accordingly (Rolling or All at once)

dgiri_india1989 · ‎11-09-2017

Apologies @nkumar for the delay in response. The issue is related to Ambari which behaves differently after disabling and re-enabling the kerberos. Issue got fixed after making changes to ambari with the help of Hortonworks Support using below REST calls. curl -u test:test -H "X-Requested-By: ambari" -X POST http://ambari-server:8080/api/v1/clusters/MyClusterName/services/KERBEROS curl -u test:test -H "X-Requested-By: ambari" -X POST http://ambari-server:8080/api/v1/clusters/MyClusterName/services/KERBEROS/components/KERBEROS_CLIENT curl -s -u test:test http://ambari-server:8080/api/v1/hosts|grep host_name| sed -n 's/.*"host_name" : "$[^\"]*$".*/\1/p'>hostcluster.txt for i in `cat hostcluster.txt`; do curl -u test:test -H "X-Requested-By: ambari" -X POST http://ambari-server:8080/api/v1/clusters/MyClusterName/hosts/$i/host_components/KERBEROS_CLIENT; done curl -u test:test -H 'X-Requested-By: ambari' -X PUT -d '{"HostRoles": {"state":"INSTALLED"}}' http://ambari-server:8080/api/v1/clusters/MyClusterName/host_components?HostRoles/state=INIT curl -H "X-Requested-By:ambari" -u test:test -i -X PUT -d @./payload.json http://ambari-server:8080/api/v1/clusters/MyClusterName

dgiri_india1989 · ‎10-06-2017

Hi @Geoffrey Shelton Okot, I have checked the content and everything looks good and we are using same krb config files across different clusters. I dont see any discrepencies with the kerberos.

dgiri_india1989 · ‎10-03-2017

Thanks @Geoffrey Shelton Okot for the quick response. Ambari is running as an user which has got sudo privileges. And auto-start services is enabled but only metrics-collector is enabled. In the KDC i can see that it has created corresponding principals associated with the service and hostnames. Only issue i have observed is it stopped creating keytab files and distribute it to the designated system which ambari reported successful. I have carried out this activity some 9-10 times but all the time its ending up without creating keytab files.

dgiri_india1989 · ‎10-03-2017

Yes I have regenerated but it didn't help. What i have seen is it didn't create new keytabs.

dgiri_india1989 · ‎10-03-2017

Hi All, I'm facing an issue while installing a new component to already kerberized cluster. The installation happens successfully without any issues but services do not start due to unavailability of keytab file on that host where new component is installed. After the installation I validated that new keytab files are not created in the designated location but ambari says it has created the keytabs and distributed to that host. Ambari : 2.5.1 HDP : 2.6.1

dgiri_india1989 · ‎09-25-2017

Thanks @Xiaoyu Yao for the details and documentation link.

dgiri_india1989 · ‎09-19-2017

Hi All, Is there a way to only make AD username as the owner of HDFS files/directories instead of userName@domainName. Current Scenario : hdfs dfs -ls /testfile -rw-r--r-- 3 dgiri@mytestdomain.com hdfs 0 2017-06-30 10:06 /testfile I want this to be like below. hdfs dfs -ls /testfile -rw-r--r-- 3 dgiri hdfs 0 2017-06-30 10:06 /testfile Please note that cluster is AD integrated and everything is working fine as expected except the files/directories ownership. Also, I'm getting below INFO message whenever I run hdfs commands. Is there a way to stop displaying below message ? 17/09/19 12:50:13 INFO util.KerberosName: No auth_to_local rules applied to dgiri@mytestdomain.com Any help is much appreciated. Thanks.

dgiri_india1989 · ‎07-18-2017

Hi All, I'm getting the same issue after kerberizing the cluster though it's a newly built one. HDP-2.6.1.0 Ambari - 2.5.1.0

dgiri_india1989 · ‎07-04-2017

Below KB article helped me to resolve the issue. https://community.hortonworks.com/content/supportkb/49037/phoenix-sqlline-query-on-larger-data-set-fails-wit.html

Online	Offline
Last Visited	‎01-30-2018 02:04 PM

Member Since	‎06-27-2017 11:29 AM
Last Visited	‎01-30-2018 02:04 PM
Posts	30
Kudos received	1

Cloudera Community

Re: Ambari is not creating keytab files though it ...

Re: Moving Journal Node directory from one volume ...

Re: Ambari is not creating keytab files though it ...

Re: Ambari is not creating keytab files though it ...

Re: Ambari is not creating keytab files though it ...

Re: Ambari is not creating keytab files though it ...

Ambari is not creating keytab files though it says...

Re: HDFS Files owner name has AD domain name

HDFS Files owner name has AD domain name

Re: Zeppelin does not start because phoenix.url ca...

Re: Phoenix - Query Timeout