I just restarted my cluster (HDP 2.6) nodes for the first time. When I ran the ambari-server start
ambari-agent start command, the Ambari UI didn't find a heartbeat from any host anymore! When I called curl -i -H "X-Requested-By: ambari" -u admin:mypassword -X GET http://localhost:8080/api/v1/hosts I get the list of my hosts, but it contains two entries for each node (one is the pure hostname, and the other one the FQDN): HTTP/1.1 200 OK
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Cache-Control: no-store
Pragma: no-cache
Set-Cookie: AMBARISESSIONID=7pm102h29dbu1670zcr416aq9;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
User: admin
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 1017
Server: Jetty(8.1.19.v20160209)
{
"href" : "http://localhost:8080/api/v1/hosts",
"items" : [
{
"href" : "http://localhost:8080/api/v1/hosts/hdp-1",
"Hosts" : {
"cluster_name" : "TestCluster",
"host_name" : "hdp-1"
}
},
{
"href" : "http://localhost:8080/api/v1/hosts/hdp-1.novalocal",
"Hosts" : {
"host_name" : "hdp-1.novalocal"
}
},
{
"href" : "http://localhost:8080/api/v1/hosts/hdp-2",
"Hosts" : {
"cluster_name" : "TestCluster",
"host_name" : "hdp-2"
}
},
{
"href" : "http://localhost:8080/api/v1/hosts/hdp-2.novalocal",
"Hosts" : {
"host_name" : "hdp-2.novalocal"
}
},
{
"href" : "http://localhost:8080/api/v1/hosts/hdp-3",
"Hosts" : {
"cluster_name" : "TestCluster",
"host_name" : "hdp-3"
}
},
{
"href" : "http://localhost:8080/api/v1/hosts/hdp-3.novalocal",
"Hosts" : {
"host_name" : "hdp-3.novalocal"
}
}
]
} This seems to confuse the ambari-server / ambari-agent, that I can't receive a heartbeat anymore! How can I solve this issue, my cluster is not usable anymore, as the services miss the heartbeat! Thank you! Update: I just saw, that I set the hostname to hdp-x before the ambari-server install, e.g.: sudo hostname hdp-1 When I restart the node(s), it has its "old" hostname again: hdp1.novalocal I just tried to make another "sudo hostname hdp-1" again, but it didn't help, is it because the ambari-server and ambari-agents start automatically after boot? Stopping and restarting the services after this "hostname hdp-1" command didn't help!
... View more
