@Kou_Bou Okay, now since you are having problems I would like first to confirm your HDP version I see you are on RHEL 7 I hope it's not higher than 7.6 as RHEL 7.7 is not yet certified with HDP or HDF see compatibility matrix To successfully deploy HDP you need to have strictly followed the Hortonworks stack installation document please confirm that you executed every step therein. I suspect a couple of issues like Firewall or passwordless ssh config issues but that can be overcome with manual registration of the hosts, the following step is valid for a single/multinode cluster let's get started. In the below steps, I am assuming you ex3cuted the steps in the above 2 documents First I would like you to use a fictitious domain name [hadoop.com]for you cluster this will help me eliminate other possible issues, I am assuming you have 2 servers and enough RAM at least 12-16 GB with 2 CPUs Servers master [Ambari-server + database + other component] node1 [datanode ] + n But the above step is valid for even a single node cluster to execute all the below steps as root Set hostname on Ambari server # hostnamectl set-hostname master.hadoop.com Verify the hostname # hostnamectl The desired output should be master.hadoop.com If not using single node do this on the subsequent hosts do the same for the remaining hosts Set hostname on other hosts # hostnamectl set-hostname nodex.hadoop.com Get the IP's On all the hosts get the IP using # ifconfig Note all the IP's including that of the Ambari server, now get the hostname of all the hosts in the cluster using Note all the output should be an FQDN. Edit the /etc/hosts on the Ambari server [master.hadoop.com] and the IP or IP's in the format IP FQDN ALIAS in case of multinode i.e 192.168.1.20 master.hadoop.com master 192.168.1.21 nodex.hadoop.com nodex If it's a multinode make sure you copy the hosts file to all other nodes !!! Check the repos are well set # ls -al /etc/yum.repos.d/ ..... ambari.repo hdp.repo The hdp and ambari repos should be accessible # yum repolist Install Ambari server # yum install -y ambari-server Setup Ambari In the below step I preparing the Ambari for Mysql or MAriaDB and NOT the embedde postgres database. I realise you were using embedded change to Mysql or MariaDB open source version of MySQL for this step I will use MariaDB but the connector is the same # ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar Backup the ambari.properties # cp /etc/ambari-server/conf/ambari.properties /etc/ambari-server/conf/ambari.properties.bak To change the default timeout of the ambari server run the below snippets # echo 'server.startup.web.timeout=120' >> /etc/ambari-server/conf/ambari.properties # echo 'server.jdbc.connection-pool.acquisition-size=5' >> /etc/ambari-server/conf/ambari.properties # echo 'server.jdbc.connection-pool.max-age=0' >> /etc/ambari-server/conf/ambari.properties # echo 'server.jdbc.connection-pool.max-idle-time=14400' >> /etc/ambari-server/conf/ambari.properties # echo 'server.jdbc.connection-pool.max-idle-time-excess=0' >> /etc/ambari-server/conf/ambari.properties # echo 'server.jdbc.connection-pool.idle-test-interval=7200' >> /etc/ambari-server/conf/ambari.properties update OS and restart the server # yum update # init 6 Install MariaDB 10.x compatibile with HDP 2.6.x - 3.x # yum install -y MariaDB-server Startup mariaDB and configure auto-start at boot # systemctl enable mariadb.service # systemctl start mariadb.service Check MariaDB is up # systemctl status mariadb Secure the MariaDB and change password important to change the default password # /usr/bin/mysql_secure_installation You already have a root password set, so you can safely answer 'n'. If you answer Y then set a new password for MariaDB Change the root password? [Y/n] Y [ Most important the rest just answer y ] Remove anonymous users? [Y/n] y ... Success Disallow root login remotely? [Y/n] y ... Success! Remove test database and access to it? [Y/n] y - Dropping test database... ... Success! - Removing privileges on test database... ... Success! Reload privilege tables now? [Y/n] y ... Success! .... Thanks for using MariaDB! Assuming you changed the root password to welcome1 and I am using ambari as the user,password and database name mysql -u root -pwelcome1 CREATE USER 'ambari'@'%' IDENTIFIED BY 'ambari'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'%'; CREATE USER 'ambari'@'localhost' IDENTIFIED BY 'ambari'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'localhost'; CREATE USER 'ambari'@'tokyo.com' IDENTIFIED BY 'ambari'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'master.hadoop.com'; FLUSH PRIVILEGES; Log on as Ambari user and create the Ambari DB mysql -u ambari -pambari CREATE DATABASE ambari; USE ambari; SOURCE /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql; exit; Create the hive, ranger, oozie, rangerkms as required again here I am simplifying by using hive as the user, password and name you database an do the same for ranger,oozie,rangerkms # mysql -u root -pwelcome1 CREATE USER 'hive'@'localhost' IDENTIFIED BY 'hive'; GRANT ALL PRIVILEGES ON *.* TO 'hive'@'localhost'; CREATE USER 'hive'@'%' IDENTIFIED BY 'hive'; GRANT ALL PRIVILEGES ON *.* TO 'hive'@'%'; CREATE USER 'hive'@'master.hadoop.com' IDENTIFIED BY '[HIVE_PASSWORD]'; GRANT ALL PRIVILEGES ON *.* TO 'hive'@'master.hadoop.com'; FLUSH PRIVILEGES; CREATE DATABASE hive; quit; Run the Ambari DB setup # ambari-server setup To use MariaDB database, and select the ambari database name, user name, and password created earlier for that database, so enter 3. When asked do not enable Ambari to automatically download and install LZO !!! After finalizing the setup start # yum install -y ambari-agent Edit the ambari-agent.ini on all the node including the ambari server,change the entry below,hostname should be the name of the ambari host master.hadoop.com vi /etc/ambari-agent/conf/ambari-agent.ini [server] hostname=master.hadoop.com url_port=8440 secured_url_port=8441 connect_retry_delay=10 max_reconnect_retry_delay=30 Save On the Ambari server and any other node install ambari-agent and start it Start the ambari server # ambari-server start Hit the Ambari UI http://master.hadoop.com:8080 This time use the option manual registration see screenshot The host(s) should register successfully!
... View more
