Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP 2.4 Cluster Failure

HDP 2.4 Cluster Failure

New Contributor

I want to know why does my 2 node HDP 2.4 cluster which I deployed several times using ambari 2.2.1.0 gets Failed.

I don't have access to the ambari UI since it hungs up saying "Loading....." forever.

I have copied the log files of ambari-server and ambari-agent from master node and slave node and attached to the ticket.

ambari-logs.tar.gz

Please let me know why I am not able to deploy the cluster.

Thanks,

Pratik

2 REPLIES 2

Re: HDP 2.4 Cluster Failure

Mentor

@Pratik Gadiya

It seems your oozie server on host https://demo-hadoop-master-template-0.novalocal:8440 is not reachable. Can yu verify that its reachable

Ambari agent

WARNING 2016-06-23 15:19:58,510 NetUtil.py:89 - Failed to connect to https://demo-hadoop-master-template-0.novalocal:8440/ca due to [Errno 111] Connection refused  
WARNING 2016-06-23 15:19:58,515 NetUtil.py:112 - Server at https://demo-hadoop-master-template-0.novalocal:8440 is not reachable, sleeping for 10 seconds... 

Ambari alert

ERROR 2016-06-23 16:20:30,713 script_alert.py:112 - [Alert][oozie_server_status] Failed with result CRITICAL: ["Execution of 'source /etc/oozie/conf/oozie-env.sh ; oozie admin -oozie http://demo-hadoop-master-template-0.novalocal:11000/oozie -status' returned 127. -bash: /etc/oozie/conf/oozie-env.sh: No such file or directory\n-bash: oozie: command not found"] 

Ambari server

23 Jun 2016 16:49:11,593  INFO [qtp-ambari-agent-154] TopologyManager:318 - TopologyManager.onHostRegistered: host = demo-hadoop-slave-template-0.novalocal is already associated with the cluster or is currently being processed
23 Jun 2016 16:49:13,957  INFO [qtp-ambari-agent-154] HeartBeatHandler:994 - Recovery configuration set to RecoveryConfig{, type=AUTO_START, maxCount=6, windowInMinutes=60, retryGap=5, maxLifetimeCount=1024, disabledComponents=, enabledComponents=METRICS_COLLECTOR}
23 Jun 2016 16:51:05,754  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:154 - Heartbeat lost from host demo-hadoop-master-template-0.novalocal 

Ambari alerts

2016-06-23 15:46:59,784 [CRITICAL] [AMBARI] [ambari_server_agent_heartbeat] (Ambari Agent Heartbeat) demo-hadoop-master-template-0.novalocal is not sending heartbeats

Re: HDP 2.4 Cluster Failure

New Contributor

The port seems to be opened

[root@demo-hadoop-master-template-0 cloud-user]# netstat -tuplen | grep 8440 tcp 0 0 :::8440 :::* LISTEN 0 20976 2498/java

[root@demo-hadoop-master-template-0 cloud-user]# telnet demo-hadoop-master-template-0.novalocal 8440 Trying X.X.X.X... Connected to demo-hadoop-master-template-0.novalocal. Escape character is '^]'.

Don't have an account?
Coming from Hortonworks? Activate your account here