Please help me to solve this problem
Solved
Go to solution
1 ACCEPTED SOLUTION
Biiiiiingo ! I specifically mentioned that see below and once again the vendor's release note is always the first point of reference.
You put in a lot of efforts and frustration I guess but if you had taken some time to read the prerequisites you won't have gone through all that
Having said that please take an accept my answer so the thread is closed and can be referenced by someone encountering the same issue.
Happy hadooping
Okay, now since you are having problems I would like first to confirm your HDP version I see you are on RHEL 7 I hope it's not higher than 7.6 as RHEL 7.7 is not yet certified with HDP or HDF see compatibility matrix
To successfully deploy HDP you need to have strictly followed the Hortonworks stack installation document please confirm that you executed every step therein.
I suspect a couple of issues like Firewall or passwordless ssh config issues but that can be overcome with manual registration of the hosts, the following step is valid for a single/multinode cluster let's get started.
In the below steps, I am assuming you ex3cuted the steps in the above 2 documents
First I would like you to use a fictitious domain name [hadoop.com]for you cluster this will help me eliminate other possible issues, I am assuming you have 2 servers and enough RAM at least 12-16 GB with 2 CPUs
Servers
master [Ambari-server + database + other component]
node1 [datanode ] + n
But the above step is valid for even a single node cluster to execute all the below steps as root
Set hostname on Ambari server
# hostnamectl set-hostname master.hadoop.com
Verify the hostname
# hostnamectl
The desired output should be master.hadoop.com
If not using single node do this on the subsequent hosts do the same for the remaining hosts
Set hostname on other hosts
# hostnamectl set-hostname nodex.hadoop.com
Get the IP's
On all the hosts get the IP using
# ifconfig
Note all the IP's including that of the Ambari server, now get the hostname of all the hosts in the cluster using
Note all the output should be an FQDN. Edit the /etc/hosts on the Ambari server
[master.hadoop.com] and the IP or IP's in the format IP FQDN ALIAS in case of multinode i.e
192.168.1.20 master.hadoop.com master
192.168.1.21 nodex.hadoop.com nodex
If it's a multinode make sure you copy the hosts file to all other nodes !!!
Check the repos are well set
# ls -al /etc/yum.repos.d/
.....
ambari.repo
hdp.repo
The hdp and ambari repos should be accessible
# yum repolist
Install Ambari server
# yum install -y ambari-server
Setup Ambari
In the below step I preparing the Ambari for Mysql or MAriaDB and NOT the embedde postgres database. I realise you were using embedded change to Mysql or MariaDB open source version of MySQL for this step I will use MariaDB but the connector is the same
# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
Backup the ambari.properties
# cp /etc/ambari-server/conf/ambari.properties /etc/ambari-server/conf/ambari.properties.bak
To change the default timeout of the ambari server run the below snippets
# echo 'server.startup.web.timeout=120' >> /etc/ambari-server/conf/ambari.properties
# echo 'server.jdbc.connection-pool.acquisition-size=5' >> /etc/ambari-server/conf/ambari.properties
# echo 'server.jdbc.connection-pool.max-age=0' >> /etc/ambari-server/conf/ambari.properties
# echo 'server.jdbc.connection-pool.max-idle-time=14400' >> /etc/ambari-server/conf/ambari.properties
# echo 'server.jdbc.connection-pool.max-idle-time-excess=0' >> /etc/ambari-server/conf/ambari.properties
# echo 'server.jdbc.connection-pool.idle-test-interval=7200' >> /etc/ambari-server/conf/ambari.properties
update OS and restart the server
# yum update
# init 6
Install MariaDB 10.x compatibile with HDP 2.6.x - 3.x
# yum install -y MariaDB-server
Startup mariaDB and configure auto-start at boot
# systemctl enable mariadb.service
# systemctl start mariadb.service
Check MariaDB is up
# systemctl status mariadb
Secure the MariaDB and change password important to change the default password
# /usr/bin/mysql_secure_installation
You already have a root password set, so you can safely answer 'n'. If you answer Y then set a new password for MariaDB
Change the root password? [Y/n] Y
[ Most important the rest just answer y ]
Remove anonymous users? [Y/n] y
... Success
Disallow root login remotely? [Y/n] y
... Success!
Remove test database and access to it? [Y/n] y
- Dropping test database...
... Success!
- Removing privileges on test database...
... Success!
Reload privilege tables now? [Y/n] y
... Success!
....
Thanks for using MariaDB!
Assuming you changed the root password to welcome1 and I am using ambari as the user,password and database name
mysql -u root -pwelcome1
CREATE USER 'ambari'@'%' IDENTIFIED BY 'ambari';
GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'%';
CREATE USER 'ambari'@'localhost' IDENTIFIED BY 'ambari';
GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'localhost';
CREATE USER 'ambari'@'tokyo.com' IDENTIFIED BY 'ambari';
GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'master.hadoop.com';
FLUSH PRIVILEGES;
Log on as Ambari user and create the Ambari DB
mysql -u ambari -pambari
CREATE DATABASE ambari;
USE ambari;
SOURCE /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql;
exit;
Create the hive, ranger, oozie, rangerkms as required again here I am simplifying by using hive as the user, password and name you database an do the same for ranger,oozie,rangerkms
# mysql -u root -pwelcome1
CREATE USER 'hive'@'localhost' IDENTIFIED BY 'hive';
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'localhost';
CREATE USER 'hive'@'%' IDENTIFIED BY 'hive';
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'%';
CREATE USER 'hive'@'master.hadoop.com' IDENTIFIED BY '[HIVE_PASSWORD]';
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'master.hadoop.com';
FLUSH PRIVILEGES;
CREATE DATABASE hive;
quit;
Run the Ambari DB setup
# ambari-server setup
To use MariaDB database, and select the ambari database name, user name, and password created earlier for that database, so enter 3.
When asked do not enable Ambari to automatically download and install LZO !!!
After finalizing the setup start
# yum install -y ambari-agent
Edit the ambari-agent.ini on all the node including the ambari server,change the entry below,hostname should be the name of the ambari host master.hadoop.com
vi /etc/ambari-agent/conf/ambari-agent.ini
[server]
hostname=master.hadoop.com
url_port=8440
secured_url_port=8441
connect_retry_delay=10
max_reconnect_retry_delay=30
Save
On the Ambari server and any other node install ambari-agent and start it
Start the ambari server
# ambari-server start
Hit the Ambari UI
This time use the option manual registration see screenshot
The host(s) should register successfully!
Announcements
What's New @ Cloudera
What's New @ Cloudera
What's New @ Cloudera
What's New @ Cloudera
What's New @ Cloudera
