@Alexander Carreño Nice to know you recreated the ambari databases and successfully launched the cluster installation. Depending on your cluster user production,test or trainging,its recommended you learn the good practice from day one. Never use embedded database but create custom database I have a preference for MariaDB or Mysql easy management and open source. You will have to create in advance databases for hive,oozie and ranger but its optional as you could do it during the configuration of the components. The disk partitioning should follow the same logic of in-built HDFS of storing 3 copies,the default replication factor of file blocks distribution in DataNodes. Having said that a good practice is to have 3 separate disk partition and different mount points. I see you are using ubuntu, you should have used custom partition eg mkdir -p /grid/0 mkdir -p /grid/1 mkdir -p /grid/2 mkdir -p /grid/x or another classic layout mkdir /u01 mkdir /u02 mkdir /u03 mkdir /u0x Please see this official cluster planning recommendation Taking into account that you have no component installed I would advice you to start afresh with a good structure. Re-install ubuntu partiion the disk accordingly see above document 3 partition of 300GB could do. Prepare the environment, firewall,ntp,passwordless etc Install MariaDB/Mysql Create the ambari database required Create databases for oozie,hive and ranger optional can be setup later. Chose the correct partition /grid/0 --/grid/x or /u01--/u0x The installation should be successful Please let me know if you need any info ... View more

@Micaël Dias I think you might need to update kafka-env.sh with additional configuration. Go to Ambari UI--->Kafka--->config--->Advanced Kafka-env--->kafka-env template Add the below line under # The java implementation to use. export KAFKA_KERBEROS_PARAMS="-Djava.security.auth.login.config=/etc/kafka/conf/kafka_jaas.conf" Save the changes and restart the Kafka service and any stale configurations. Keep me posted. ... View more

@@Alexander Carreño How did you create your Postgres database? what was your choice Select n at Enter advanced database configuration? That shows it isn't the embedded but create manually right? There are 4 scripts in /var/lib/ambari-server/resources/ Ambari-DDL-Postgres-CREATE.sql Ambari-DDL-Postgres-DROP.sql Ambari-DDL-Postgres-EMBEDDED-CREATE.sql Ambari-DDL-Postgres-EMBEDDED-DROP.sql So you have 2 choices Ambari-DDL-Postgres-EMBEDDED-DROP.sql and Ambari-DDL-Postgres-DROP.sql to use evidently, you can see the difference and run a new ambari setup.. Below is a silent option setup for embedded database option. ambari-server setup-s --database=embedded|oracle|mysql|postgres --databasehost=Hostname of database server --databaseport=Database port --databasename=Database/Schema/Service name or ServiceID --databaseusername=Database user login --databasepassword=Database user password Please drop and recreate the ambari database to enable you to continue. If you prefer Mysql or MariaDB follow the below steps ################################################ # Install MySQL or MariaDB database for Ambari on Centos/RHEL 7 ############################################### # yum install -y ambari-server or yum install -y mariadb-server # chkconfig mysqld --level 345 on # yum install -y mysql-connector-java # service mysqld start # service mysqld status # ls /usr/share/java/mysql-connector-java.jar ################################################ # Startup at server bootup for MySQL or MariaDB database for Ambari on Centos/RHEL 7 ############################################### sudo systemctl enable mariadb sudo systemctl start mariadb sudo ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar ############################################# # Install MySQL database for Ambari ############################################## # mysql -u root UPDATE mysql.user SET Password=PASSWORD('welcome1') WHERE User='root'; flush privileges; ############################## # Using Ambari user for MySQL ################################### mysql -u root -pwelcome1 CREATE USER 'ambari'@'%' IDENTIFIED BY 'ambari'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'%'; CREATE USER 'ambari'@'localhost' IDENTIFIED BY 'ambari'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'localhost'; grant all privileges on *.* to 'ambari'@'localhost' identified by 'ambari'; CREATE USER 'ambari'@'bombo.uganda.com' IDENTIFIED BY 'ambari'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'FQDN_for_Ambari'; FLUSH PRIVILEGES; ##################################################3 # Create the Ambari DB as user Ambari ################################################### mysql -u ambari -pambari CREATE DATABASE ambari; USE ambari; SOURCE /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql; Now you can proceed with the ambari setup ################################################## # Ambari setup ################################################## # ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar ################################################## # Setup ambari-server for Mysql database. ################################################## # ambari-server setup Using python /usr/bin/python Setup ambari-server Checking SELinux... SELinux status is 'enabled' SELinux mode is 'permissive' WARNING: SELinux is set to 'permissive' mode and temporarily disabled. OK to continue [y/n] (y)? y Customize user account for ambari-server daemon [y/n] (n)? Adjusting ambari-server permissions and ownership... Checking firewall status... Checking JDK... [1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8 [2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7 [3] Custom JDK ============================================================================== Enter choice (1): To download the Oracle JDK and the Java Cryptography Extension (JCE) Policy Files you must accept the license terms found at http://www.oracle.com/technetwork/java/javase/terms/license/index.html and not accepting will cancel the Ambari Server setup and you must install the JDK and JCE files manually. Do you accept the Oracle Binary Code License Agreement [y/n] (y)? Downloading JDK from http://public-repo-1.hortonworks.com/ARTIFACTS/jdk-8u77-linux-x64.tar.gz to /var/lib/ambari-server/resources/jdk-8u77-linux-x64.tar.gz jdk-8u77-linux-x64.tar.gz... 100% (173.0 MB of 173.0 MB) Successfully downloaded JDK distribution to /var/lib/ambari-server/resources/jdk-8u77-linux-x64.tar.gz Installing JDK to /usr/jdk64/ Successfully installed JDK to /usr/jdk64/ Downloading JCE Policy archive from http://public-repo-1.hortonworks.com/ARTIFACTS/jce_policy-8.zip to /var/lib/ambari-server/resources/jce_policy-8.zip Successfully downloaded JCE Policy archive to /var/lib/ambari-server/resources/jce_policy-8.zip Installing JCE policy... Completing setup... Configuring database... Enter advanced database configuration [y/n] (n)? y Configuring database... ============================================================================== Choose one of the following options: [1] - PostgreSQL (Embedded) [2] - Oracle [3] - MySQL / MariaDB [4] - PostgreSQL [5] - Microsoft SQL Server (Tech Preview) [6] - SQL Anywhere [7] - BDB ============================================================================== Enter choice (1): 3 Hostname (localhost): Port (3306): Database name (ambari): Username (ambari): Enter Database Password (bigdata): Re-enter password: Configuring ambari database... Copying JDBC drivers to server resources... Configuring remote database connection properties... WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql Proceed with configuring remote database connection properties [y/n] (y)? Extracting system views... ambari-admin-2.4.1.0.22.jar ........... Adjusting ambari-server permissions and ownership... Ambari Server 'setup' completed successfully. Hope that helps ... View more

@Alexander Carreño Check metainfo data in the databases psql -U ambari -d ambari; Password for user ambari psql (8.4.20) Type "help" for help. ambari=> SELECT "metainfo_key", "metainfo_value" FROM metainfo; If you get 0 rows then continue with the below That's because the postgres table/db corruption.Please run the below command to reset postgres ambari DB # ambari-server reset Using python /usr/bin/python Resetting ambari-server **** WARNING **** You are about to reset and clear the Ambari Server database. This will remove all cluster host and configuration information from the database. You will be required to re-configure the Ambari server and re-run the cluster wizard. Are you SURE you want to perform the reset [yes/no] (no)? yes Confirm server reset [yes/no](no)? yes Resetting the Server database... Connecting to local database...done. WARNING: Non critical error in DDL, use --verbose for more information Ambari Server 'reset' completed with warnings. Restart Ambari #ambari-server start All should run successfully and you should be able to log on. Please revert ... View more

@L Hurley Then you need to start it to load the Ambari UI login page # ambari-server start Thats it ... View more

@Sam Red Panic NOT 🙂 Just to be sure of the step you took. 1. Did the Ambari kerberization succeed with errors? 2. Can you paste the contents of /etc/security/keytabs/* 3. Can you list principals in the KDC database? # kadmin.local kadmin.local: listprincs 4.Did you make the changes I pointed out earlier 5. Can you share the files the below files remember to scramble the private details /etc/krb5.conf /var/kerberos/krb5kdc/kdc.conf /var/kerberos/krb5kdc/kadm5.acl 6. Can you validate that service keytabs were create on all host in /etc/security/keytabs/* where service like YARN,Zookeeper or ranger are installed. Please revert ... View more

@Alexander Carreño I assume you referenced this official document The database creation script has to run as user awv_user and this user doesn't exist !! Did you run this step CREATE USER awv_user WITH PASSWORD 'xxxx'; Can you check that the permission is correct for the script in /var/lib/ambari-server/resources/Ambari-DDL-Postgres-CREATE.sql Please create the above user following the document above and retry. ... View more

@Sam Red 1) By the looks your /etc/krb5.conf doesn't look right. In the case your REALM is RELAY please follow strictly the below notice some are upper and lower case and also the .relay in teh domain_realm section. [libdefaults] renew_lifetime = 7d forwardable = true default_realm = RELAY.COM ticket_lifetime = 24h dns_lookup_realm = false dns_lookup_kdc = false default_ccache_name = /tmp/krb5cc_%{uid} #default_tgs_enctypes = aes des3-cbc-sha1 rc4 des-cbc-md5 #default_tkt_enctypes = aes des3-cbc-sha1 rc4 des-cbc-md5 [domain_realm] relay.com = RELAY.COM .relay.com = RELAY.COM [logging] default = FILE:/var/log/krb5kdc.log admin_server = FILE:/var/log/kadmind.log kdc = FILE:/var/log/krb5kdc.log [realms] RELAY.COM = { admin_server = gulu.relay.com kdc = gulu.relay.com } 2) I see many entries where do the come from its wrong, there shouldn't be any entries except if you have a kerberos HA setup for the failover KDC kdc = IP kdc = IP kdc = IP kdc = IP kdc = IP kdc = IP 3) Were the keytabs created correctly in /etc/security/keytabs/* ? Can you grab a valid kerberos ticket in the below example I first list the principal available for user opera1 whos keytab is opera1.keytab List principal for opera1 # klist -kt /etc/security/keytabs/opera1.keytab Keytab name: FILE:/etc/security/keytabs/opera1.keytab KVNO Timestamp Principal ---- ------------------- 1 08/24/2017 18:28:26 opera1@RELAY.COM Grab a kerberos ticket # kinit -kt /etc/security/keytabs/opera1.keytab opera1@RELAY.COM List the kerberos ticket to see validity # klist Ticket cache: FILE:/tmp/krb5cc_0 Default principal: opera1@RELAY.COM Valid starting Expires Service principal 08/25/2017 20:33:43 08/26/2017 20:33:42 krbtgt/RELAY.COM@RELAY.COM Please let me know ... View more