- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Ambari agent registration of HDF cluster fails inspite of exitcode 0. Setup of RHEL on MS Azure.
- Labels:
-
Apache Ambari
-
Cloudera DataFlow (CDF)
Created ‎05-16-2018 12:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
==========================
Creating target directory... ========================== Command start time 2018-05-16 06:08:52 chmod: cannot access ‘/var/lib/ambari-agent/data’: No such file or directory Warning: Permanently added 'mtvm6.eastus.cloudapp.azure.com,40.117.251.23' (ECDSA) to the list of known hosts. Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:52 ========================== Copying ambari sudo script... ========================== Command start time 2018-05-16 06:08:52 scp /var/lib/ambari-server/ambari-sudo.sh host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:53 ========================== Copying common functions script... ========================== Command start time 2018-05-16 06:08:53 scp /usr/lib/python2.6/site-packages/ambari_commons host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:53 ========================== Copying create-python-wrap script... ========================== Command start time 2018-05-16 06:08:53 scp /var/lib/ambari-server/create-python-wrap.sh host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:54 ========================== Copying OS type check script... ========================== Command start time 2018-05-16 06:08:54 scp /usr/lib/python2.6/site-packages/ambari_server/os_check_type.py host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:54 ========================== Running create-python-wrap script... ========================== Command start time 2018-05-16 06:08:54 Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:55 ========================== Running OS type check... ========================== Command start time 2018-05-16 06:08:55 Cluster primary/cluster OS family is redhat7 and local/current OS family is redhat7 Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:55 ========================== Checking 'sudo' package on remote host... ========================== Command start time 2018-05-16 06:08:55 sudo-1.8.19p2-11.el7_4.x86_64 Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:56 ========================== Copying repo file to 'tmp' folder... ========================== Command start time 2018-05-16 06:08:56 scp /etc/yum.repos.d/ambari.repo host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:57 ========================== Moving file to repo dir... ========================== Command start time 2018-05-16 06:08:57 Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:57 ========================== Changing permissions for ambari.repo... ========================== Command start time 2018-05-16 06:08:57 Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:57 ========================== Copying setup script file... ========================== Command start time 2018-05-16 06:08:57 scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:08:58 ========================== Running setup agent script... ========================== Command start time 2018-05-16 06:08:58 ("INFO 2018-05-16 06:09:18,024 main.py:145 - loglevel=logging.INFO INFO 2018-05-16 06:09:18,024 main.py:145 - loglevel=logging.INFO INFO 2018-05-16 06:09:18,024 main.py:145 - loglevel=logging.INFO INFO 2018-05-16 06:09:18,025 DataCleaner.py:39 - Data cleanup thread started INFO 2018-05-16 06:09:18,027 DataCleaner.py:120 - Data cleanup started INFO 2018-05-16 06:09:18,027 DataCleaner.py:122 - Data cleanup finished INFO 2018-05-16 06:09:18,028 hostname.py:67 - agent:hostname_script configuration not defined thus read hostname 'mtvm6.eastus.cloudapp.azure.com' using socket.getfqdn(). INFO 2018-05-16 06:09:18,035 PingPortListener.py:50 - Ping port listener started on port: 8670 INFO 2018-05-16 06:09:18,038 main.py:437 - Connecting to Ambari server at https://myhdf.eastus.cloudapp.azure.com:8440 (104.211.60.99) INFO 2018-05-16 06:09:18,038 NetUtil.py:70 - Connecting to https://myhdf.eastus.cloudapp.azure.com:8440/ca ", None) ("INFO 2018-05-16 06:09:18,024 main.py:145 - loglevel=logging.INFO INFO 2018-05-16 06:09:18,024 main.py:145 - loglevel=logging.INFO INFO 2018-05-16 06:09:18,024 main.py:145 - loglevel=logging.INFO INFO 2018-05-16 06:09:18,025 DataCleaner.py:39 - Data cleanup thread started INFO 2018-05-16 06:09:18,027 DataCleaner.py:120 - Data cleanup started INFO 2018-05-16 06:09:18,027 DataCleaner.py:122 - Data cleanup finished INFO 2018-05-16 06:09:18,028 hostname.py:67 - agent:hostname_script configuration not defined thus read hostname 'mtvm6.eastus.cloudapp.azure.com' using socket.getfqdn(). INFO 2018-05-16 06:09:18,035 PingPortListener.py:50 - Ping port listener started on port: 8670 INFO 2018-05-16 06:09:18,038 main.py:437 - Connecting to Ambari server at https://myhdf.eastus.cloudapp.azure.com:8440 (104.211.60.99) INFO 2018-05-16 06:09:18,038 NetUtil.py:70 - Connecting to https://myhdf.eastus.cloudapp.azure.com:8440/ca ", None) Connection to mtvm6.eastus.cloudapp.azure.com closed. SSH command execution finished host=mtvm6.eastus.cloudapp.azure.com, exitcode=0 Command end time 2018-05-16 06:09:20 Registering with the server... Registration with the server failed.
Created ‎05-19-2018 08:13 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am happy you have succeeded. Next time you can now help someone with the setup of HDF in Azure 🙂
Yes, the database could be set on any node but as you have already Postgres installed for Ambari it's easier to have the other databases on the same host for easier management.
CAUTION:
When in production think of setting database replication in the future.
Once you have finished the setup If you found this answer addressed your question, please take a moment to log in and click the "Accept" link on the answer.
Keep me posted
Created ‎05-18-2018 08:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
reverse lookup fails with
** server can't find 23.251.117.40.in-addr.arpa.: NXDOMAIN
Regarding your question
Can you check your /etc/named.conf file disable by setting it to no
currently there is no /etc/named.conf file. I believe this is because I am using the Azure DNS service. Do you think I should install bind ?
Created ‎05-18-2018 08:48 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I use both private and public IP addresses in /etc/hosts
eg
40.117.159.94 10.0.0.6 myhdf.eastus.cloudapp.azure.com myhdf
40.117.251.23 10.0.0.5 mtvm6.eastus.cloudapp.azure.com mtvm6
104.41.128.170 10.0.0.7 mtvm5.eastus.cloudapp.azure.com mtvm5
Created ‎05-18-2018 08:50 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
again there is no /etc/named.conf because we the Azure DNS service
Created ‎05-18-2018 08:50 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created ‎05-18-2018 08:51 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
again there is no /etc/named.conf because we the Azure DNS service
Created ‎05-18-2018 08:53 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ok, let me study docs you suggest.
Created ‎05-18-2018 08:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ok, let me study docs you suggest.
Created ‎05-18-2018 08:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
If you are using both Private and public I think the entry should look rather like this, more elegant !! Your earlier entry will not work as you have concatenated 2 IP's
40.117.159.94 10.0.0.6 myhdf.eastus.cloudapp.azure.com myhdf
####################### Private IP's ####################### 40.117.159.94 myhdf.eastus.cloudapp.azure.com myhdf 40.117.251.23 mtvm6.eastus.cloudapp.azure.com mtvm6 104.41.128.170 mtvm5.eastus.cloudapp.azure.com mtvm5 ####################### Public IP's ####################### 10.0.0.6 myhdf.eastus.cloudapp.azure.com myhdf 10.0.0.5 mtvm6.eastus.cloudapp.azure.com mtvm6 10.0.0.7 mtvm5.eastus.cloudapp.azure.com mtvm5
Replace that on all the servers and let me know
Created ‎05-19-2018 07:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Geoffrey, really cool: the registration of the HDF cluster was now successful. The error was the missing reverse DNS on Azure. I have read the Azure article you suggested and implemented everything. Then it worked. You made my day thanks ! Now I will proceed with the HDF installation.
Created ‎05-19-2018 07:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
another question on this: where do you propose the databases in the HDF cluster ? Can I install them on one of the nodes, i.e. mtvm6, or better on the myhdf with ambari server or better elsewhere ?