Member since
01-19-2017
3676
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 611 | 06-04-2025 11:36 PM | |
| 1177 | 03-23-2025 05:23 AM | |
| 584 | 03-17-2025 10:18 AM | |
| 2186 | 03-05-2025 01:34 PM | |
| 1375 | 03-03-2025 01:09 PM |
10-16-2017
11:48 AM
@subhash parise On the offending node, do the following, bizzare thee are no files in /var/lib/ambari-agent/data: Stop and remove ambari-agent ambari-agent stop
yum erase ambari-agent
rm -rf /var/lib/ambari-agent
rm -rf /var/run/ambari-agent
rm -rf /usr/lib/amrbari-agent
rm -rf /etc/ambari-agent
rm -rf /var/log/ambari-agent
rm -rf /usr/lib/python2.6/site-packages/ambari* Re-install the Ambari Agent yum install ambari-agent
vi /etc/ambari-agent/conf/ambari-agent.ini Change hostname to Ambari Server [server]
hostname={Ambari-server_host_FQDN}
url_port=8440
secured_url_port=8441
connect_retry_delay=10
max_reconnect_retry_delay=30 Restart the agent ambari-agent start That should resolve the issue
... View more
10-16-2017
11:30 AM
@raouia What were the components on the deleted host? I don't quite understand "My cluster was composed of an ambari-server and 2 ambari-agents. I removed one node from ambari agents." Do you mean it was a 3 node cluster (1 master and 2 slaves) if so how was the component distributed? I am more concerned about the delete host?
... View more
10-16-2017
10:56 AM
@subhash parise Your Ambari is SSL enabled did you by chance also enable 2 ways SSL between Ambari Server and Ambari Agents? see doc Here is a HCC document that can also help you achieve that. Enable 2 way SSL between Ambari-Server and Ambari-agents in Ambari 2.5 Hope that helps
... View more
10-16-2017
10:49 AM
@raouia Could you attach the zookeeper logs in /var/log/zookeeper? You mean the zookeeper was running before did you restart it , that's when you realised it could start? Did you make any config changes through Ambari or not? Is it possible to get a longer stack trace of the error.png? Because the interesting part is missing.
... View more
10-16-2017
10:38 AM
@ilia kheifets I am positive it will work! And once it does don't forget to accept my answer. That way other HCC users can quickly find the solution when they encounter the same issue. Please let me know
... View more
10-16-2017
09:06 AM
@ilia kheifets Here we go all the services up and running without major issues !!! Did you install java with JCE? standard procedure? I have seen your comments but at times we ignore the obvious well-documented steps. I followed usual steps and all is up and running. As I have demonstrated that the procedure is OK and valid, this answered your question.
... View more
10-15-2017
09:11 PM
@Neha G If you have sudo privileges just do this you will need a valid kerberos ticket just realised you have a kerberized cluster $sudo su - hdfs List the correct principal for hdfs $ klist -kt /etc/security/keytabs/hdfs.headless.keytab Keytab name: FILE:/etc/security/keytabs/hdfs.headless.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 15:42:23 hdfs-cluster@YOUR_REALM Then grab a valid kerbero ticket $ kinit -kt /etc/security/keytabs/hdfs.headless.keytab hdfs-cluster@YOUR_REALM Then $ hdfs dfsadmin -safemode leave That should work now !
... View more
10-15-2017
09:06 PM
subsequent screenshots
... View more
10-15-2017
09:03 PM
1 Kudo
@ilia kheifets As promised I tried to recreate your environment on a 1 node cluster running Ubuntu 16.04 in a VM with 12 GB RAM.After the installations find below the high-level steps I performed. The Cluster is installing without any issues Generate public and private SSH keys on the Ambari Server host. root@ubuntu17:~# ssh-keygen Accepted default values,copy the SSH Public Key (id_rsa.pub) to the root account on your target hosts if multi-node. .ssh/id_rsa .ssh/id_rsa.pub Add the SSH Public Key to the authorized_keys file on your target hosts. root@ubuntu17:~# cat id_rsa.pub >> authorized_keys
root@ubuntu17:~# chmod 700 ~/.ssh
root@ubuntu17:~# chmod 600 ~/.ssh/authorized_keys Set NTPD root@ubuntu17:~# apt-get install ntp
root@ubuntu17:~# update-rc.d ntp defaults Set the host FQDN in my case the Ambari server vi /etc/hosts ---- IP--FDN--ALIAS 192.168.0.172 ubuntu17.kenya.com ubuntu17 Edit host name root@ubuntu17:~# vi /etc/hostname
ubuntu17.kenya.com Firewall settings root@ubuntu17:~# sudo ufw disable
The program 'setenforce' is currently not installed.So I installed
The program 'setenforce' is currently not installed.So I installed root@ubuntu17:~# apt install selinux-utils Disable SE-Linux root@ubuntu17:~# setenforce 0 Set UMASK root@ubuntu17:~# umask 0022
root@ubuntu17:~# echo umask 0022 >> /etc/profile Download Ambari repo files root@ubuntu17:~# wget -O /etc/apt/sources.list.d/ambari.list http://public-repo-1.hortonworks.com/ambari/ubuntu16/2.x/updates/2.5.2.0/ambari.list Grab the key root@ubuntu17:~# apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD Update root@ubuntu17:~# apt-get update root@ubuntu17:~# apt-cache showpkg ambari-server
root@ubuntu17:~# apt-cache showpkg ambari-agent
root@ubuntu17:~# apt-cache showpkg ambari-metrics-assembly Install Java Openjdk comes with JCE root@ubuntu17:~# sudo apt-get install openjdk-8-jdk Install Ambari server here I used the root user root@ubuntu17:~# apt-get install ambari-server
root@ubuntu17:~# ambari-server setup Setup as root user with default postgres databases root@ubuntu17:~# ambari-server start
Ambari Server 'start' completed successfully. Get the FQDN for the ambari server root@ubuntu17:~# hostname -f
ubuntu17.kenya.com So my Ambari URL will be http://ubuntu17.kenya.com:8080 See attached screenshot,got an error with THP so had to disable root@ubuntu17:~/.ssh# cat /sys/kernel/mm/transparent_hugepage/enabled [always] madvise never
root@ubuntu17:~/.ssh# echo never > /sys/kernel/mm/transparent_hugepage/enabled
root@ubuntu17:~/.ssh# echo never > /sys/kernel/mm/transparent_hugepage/defrag
root@ubuntu17:~/.ssh# cat /sys/kernel/mm/transparent_hugepage/enabled always madvise [never] Setup Mysql database for hive ,oozie etc root@ubuntu17:~# sudo apt-get update
root@ubuntu17:~# sudo apt-get install mysql-server
root@ubuntu17:~# sudo mysql_secure_installation
root@ubuntu17:~# apt-get install -y libpostgresql-jdbc-java
root@ubuntu17:~# apt-get install libmysql-java
root@ubuntu17:~# ls /usr/share/java/mysql-connector-java.jar Check that the mysql connector is present at that location root@ubuntu17:~# ls /usr/share/java/mysql-connector-java.jar Create the hive,oozie and ranger databases in Mysql with the correct privileges created database for hive successfully created database for oozie successfully created database for ranger successfully Run this command # ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar Proceeded with the cluster installation http://ubuntu17.kenya.com:8080 See attached screenshots
... View more
10-15-2017
08:16 PM
@Neha G I think I have seen a typo error in your command can you copy and paste the below command sudo su - hdfs hdfs dfsadmin -safemode leave And let me know
... View more