We have a four-node Hadoop cluster with HDP 2.4 and Kerberos installed in it. As this is our production cluster, We wanted to have HA for all the services including the PostgreSQL database which is used by Hive, Ambari, and Oozie for storing the metadata. However, the version of our PostgreSQL, which is 8.4.2 doesn't support the inbuilt feature(stream replication) of Postgres. So, we have decided to upgrade PostgreSQL to a version(9.3) ambari supports. I followed this link to upgrade the Postgres. Everything went well. Expect that, we are getting the following error when restarting ambari server. Ambari Server running with administrator privileges. Running initdb: This may take upto a minute. Data directory is not empty! [FAILED] Could someone help? Thanks. ... View more

Hi, We are planning to set up HDP 2.4 on 6 node production cluster with services like HDFS, MapReduce, Yarn, Hive, HBase, Oozie, Zookeper, Knox, Ranger. We also want to integrate all the nodes with AD using SSSD and add kerberos security to it. Please find below configuration details of these nodes. 20 cores per machine 128 to 440GB 36 TB storage we are planning to have HA enabled. Any suggestion on how the services should be spread across nodes? Is it advisable to have Ambari server and name-node on the same node? Even if we handle the name-node disaster using HA enabled for name-node. As Ambari don't have HA. How do we handle the situation, if a node with Ambari server install go down ? Is it advisable to have a edge node ? What are the advantages of having it ? Can edge node have different OS than the cluster OS ? I think that its not possible to have edge node with different version of OS as the clients need to installed in it. But the situation is that, we are using Red hat 7 for cluster and we want to use HUE. Hue being incompatible with Red hat 7, only option we can think of is, having an edge node with Cent-OS 6 and installing hue in it. Is there any other way to achieve this ? If we have a edge node, as this is the single point of access to cluster resources. Do we still need to have AD integrated with all the cluster nodes or edge node alone will do the thing?(assuming the kerberos is enabled in cluster.) ... View more

I have integrated my hue.ini configuration file for both Direct and search bind. It was able to identify the users in search bind but giving an error "user DN/password rejected by LDAP server." only for some users are able to login into it. Any idea about root cause of this error? The same is the problem with ranger and ambari . Is it because other users don't have special privileges which these users have? Logs attached. [20/May/2016 20:38:48 +0000] backend DEBUG Django user vinay.potnuru does not have a profile to populate [20/May/2016 20:38:48 +0000] backend DEBUG Populating Django user vinay.potnuru [20/May/2016 20:38:48 +0000] config DEBUG search_s('OU=Developers,DC=company,DC=com', 2, '(&(sAMAccountName=%(user)s)(objectclass=*))') returned 1 objects: cn=vinay potnuru,ou=users,ou=Developers,dc=company,dc=com [20/May/2016 20:38:48 +0000] access DEBUG 172.16.0.155 -anon- - "POST /accounts/login/ HTTP/1.1" [20/May/2016 20:38:44 +0000] access WARNING 172.16.0.155 -anon- - "POST /accounts/login/ HTTP/1.1" -- Failed login for user "koushik.veldanda" [20/May/2016 20:38:44 +0000] backend DEBUG Authentication failed for koushik.veldanda: user DN/password rejected by LDAP server. [20/May/2016 20:38:44 +0000] config DEBUG search_s('OU=Developers,DC=company,DC=com', 2, '(&(sAMAccountName=%(user)s)(objectclass=*))') returned 1 objects: cn=koushik veldanda,ou=users,ou=Developers,dc=company,dc=com ... View more