Member since
04-03-2019
962
Posts
1743
Kudos Received
146
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 14998 | 03-08-2019 06:33 PM | |
| 6178 | 02-15-2019 08:47 PM | |
| 5098 | 09-26-2018 06:02 PM | |
| 12591 | 09-07-2018 10:33 PM | |
| 7446 | 04-25-2018 01:55 AM |
11-28-2016
01:37 PM
4 Kudos
Sometimes, after disabling Kerberos successfully, you can get below error while accessing NN or RM UIs. . Because of this, all the alerts, Ambari metrics data can be broken because JMX data won't be available to Ambari Metrics or Alerts via HTTP. . Resolution: Modify below propery in core-site.xml via Ambari and restart required services. hadoop.http.authentication.simple.anonymous.allowed=true Note - Most of the times issue happens because of this property being set as false after disabling Kerberos . Please also compare below property and see if it is correct.
hadoop.security.authentication=simple .Issue is simple but it takes lot of time to troubleshoot. Hence posting this article to reduce someone's time 🙂 Please comment if you face any issues or need any further help on this. Happy Hadooping!! 🙂
... View more
Labels:
11-23-2016
08:15 PM
3 Kudos
@Krish Khambadkone Please refer below automated script for this https://community.hortonworks.com/articles/34747/ambari-admin-utility.html
... View more
11-21-2016
09:57 AM
1 Kudo
@Mangesh Berde Can you please check your /etc/hue/conf/hue.ini to see if its pointing to correct Oozie server? also can you please make sure that your Oozie server is up and running. you can also verify by checking Oozie web UI
... View more
11-18-2016
09:02 PM
3 Kudos
@SBandaru Suppose you have two Namenodes A and B. A is active and B is Standby --> If you restart Namenode A, ZKFC(Zookeeper failover controller) will detect that Namenode A is not reachable(When daemon is restarting), fencing will happen and Namenode B will be active NN. --- B is active and A is Standby --> If you restart both the Namenodes, whichever comes up first and respond to ZKFC will become active and ultimately another one will become standby. --- Now both Namenode thinks that they are active and sends write request to quorum journal manager with their epoc number, how QJM handles this situation? Quorum journal manager stores epoc number locally which called as promised epoc. Whenever JournalNode receives RPC request along with epoc number from Namenode, it compares the epoch number with promised epoch. If request is coming from newer node which means epoc number is greater than promised epoc then itrecords new epoc number as promised epoc. If the request is coming from Namenode with older epoc number, then QJM simply rejects the request. Please refer - https://community.hortonworks.com/articles/27225/how-qjm-works-in-namenode-ha.html for more details about how QJM works. Hope this information helps! 🙂
... View more
11-18-2016
01:42 PM
4 Kudos
@Kirk Haslbeck We can use protected directory feature for production to avoid accidental deletion of data from HDFS https://issues.apache.org/jira/browse/HDFS-8983
... View more
11-16-2016
07:38 PM
3 Kudos
@Muthukumar S Please check - https://community.hortonworks.com/questions/29862/how-to-protect-hdfs-directories-from-deletion-by-m.html There is new feature of protected directories available from hadoop 2.8.0 onwards. https://issues.apache.org/jira/browse/HDFS-8983 Hope this information helps! 🙂
... View more
11-16-2016
07:34 PM
3 Kudos
@Premc J Those must be TEZ containers initialized for hive shells. Do you have any open hive sessions? can you please check all the edge node and try to kill them? Also please check tez.am.container.idle.release-timeout-max.millis property.
... View more
11-16-2016
04:03 PM
4 Kudos
I got it. /etc/hive/conf/conf.server I was searching all the time in /etc/hive/conf/hive-site.xml and was assuming that /etc/hive/conf.server does not exists.
... View more
11-16-2016
03:32 PM
2 Kudos
I remember there was this property(mentioned below) in hive-site.xml for metastore password. <property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>as_if_I'm_going_to_paste_my_password_here</value>
</property> I cannot see it in my hive-site.xml (HDP-2.5.0.0), I think we have some credential provider configured for this but I'm unable to find that property in hive-site.xml as well. <!-- Configure credential store for passwords-->
<property>
<name>hadoop.security.credential.provider.path</name>
<value>jceks://file/usr/lib/hive/conf/hive.jceks</value>
</property> Any idea where it stores the password?
... View more
Labels: