Created on 05-22-2018 01:57 AM - edited 09-16-2022 06:15 AM
Hello,
I am novice in the installation of CDH. I need to install CDH in 5 instances EC2 of AWS.
But I have a problem whith the parcels in the step number 4:
Any idea?¿ I don´t know what I to do about it. Thanks for your help.
Created 05-22-2018 07:43 AM
Hi @nonames,
I could be for more than one reasons.
Can you show us, any logs?
Veo que dispones de Cloduera en Español, por si lo prefieres. Puedes intentar hacer click en los botones rojos que te aparecen justo debajo (como aparece en tu imagen) algo más de detalle se te muestra.
Regards,
Manu.
Created 05-22-2018 07:43 AM
Hi @nonames,
I could be for more than one reasons.
Can you show us, any logs?
Veo que dispones de Cloduera en Español, por si lo prefieres. Puedes intentar hacer click en los botones rojos que te aparecen justo debajo (como aparece en tu imagen) algo más de detalle se te muestra.
Regards,
Manu.
Created on 05-22-2018 01:33 PM - edited 05-22-2018 01:37 PM
Hi @manuroman thanks for you help.I include the manager server log (sorry but it is very long):
Regards
PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:18:22,420 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT1.244S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:18:22,421 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT1.220S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:18:22,481 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from REFRESH_METADATA (PT32.007S) to PACKAGE_INSTALL oracle-j2sdk1.7 2018-05-22 16:18:23,279 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT1.017S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:18:23,481 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT1S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:18:24,201 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:18:24,421 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2.001S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:18:24,421 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:18:25,279 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2S) to INSTALL_JCE 2018-05-22 16:18:25,280 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from INSTALL_JCE (PT0.001S) to AGENT_CONFIGURE 2018-05-22 16:18:25,280 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:18:25,422 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE 2018-05-22 16:18:25,422 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from INSTALL_JCE (PT0S) to AGENT_CONFIGURE 2018-05-22 16:18:25,422 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:18:25,733 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_START (PT0.453S) to SCRIPT_SUCCESS 2018-05-22 16:18:25,733 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:18:25,925 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from AGENT_START (PT0.503S) to SCRIPT_SUCCESS 2018-05-22 16:18:25,926 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:18:26,202 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2.001S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from TAKE_LOCK (PT36.007S) to DETECT_ROOT 2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from DETECT_ROOT (PT0S) to DETECT_DISTRO 2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from DETECT_DISTRO (PT0S) to DETECT_SCM 2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from DETECT_SCM (PT0S) to CLOUD_SPECIFIC_CONFIGURE 2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from CLOUD_SPECIFIC_CONFIGURE (PT0S) to REPO_INSTALL 2018-05-22 16:18:26,270 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA 2018-05-22 16:18:26,422 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2.001S) to INSTALL_JCE 2018-05-22 16:18:26,423 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from INSTALL_JCE (PT0.001S) to AGENT_CONFIGURE 2018-05-22 16:18:26,423 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:18:27,203 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE 2018-05-22 16:18:28,072 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from INSTALL_JCE (PT0.868S) to AGENT_CONFIGURE 2018-05-22 16:18:28,072 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0.001S) to AGENT_START 2018-05-22 16:18:28,073 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from AGENT_START (PT0.001S) to SCRIPT_SUCCESS 2018-05-22 16:18:28,073 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:18:28,319 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: AgentAvroServlet: heartbeat processing stats: average=8ms, min=8ms, max=8ms. 2018-05-22 16:18:28,425 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_START (PT1.999S) to SCRIPT_SUCCESS 2018-05-22 16:18:28,425 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0.003S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:18:28,466 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host fa42d1c5-8343-4b3c-b295-033320f166f8: /default 2018-05-22 16:18:28,590 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=1, hostId=fa42d1c5-8343-4b3c-b295-033320f166f8, hostName=ip-172-31-26-30.ec2.internal}] Added to rack group: /default 2018-05-22 16:18:28,616 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#1) has changed]}. 2018-05-22 16:18:28,616 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence 2018-05-22 16:18:28,616 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check 2018-05-22 16:18:28,638 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles. 2018-05-22 16:18:28,639 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.004S 2018-05-22 16:18:28,639 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms. 2018-05-22 16:18:28,643 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host 1de1e66a-16f1-4cd0-af94-f99ce59f7d4c: /default 2018-05-22 16:18:28,644 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=2, hostId=1de1e66a-16f1-4cd0-af94-f99ce59f7d4c, hostName=ip-172-31-21-217.ec2.internal}] Added to rack group: /default 2018-05-22 16:18:28,655 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#2) has changed]}. 2018-05-22 16:18:28,655 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence 2018-05-22 16:18:28,655 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check 2018-05-22 16:18:28,684 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles. 2018-05-22 16:18:28,685 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.004S 2018-05-22 16:18:28,685 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms. 2018-05-22 16:18:28,759 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: New state is a done state 2018-05-22 16:18:28,759 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.026S) to COMPLETE 2018-05-22 16:18:28,759 INFO NodeConfiguratorThread-0-5:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:18:28,944 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: New state is a done state 2018-05-22 16:18:28,944 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.019S) to COMPLETE 2018-05-22 16:18:28,944 INFO NodeConfiguratorThread-0-1:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from TAKE_LOCK (PT39.007S) to DETECT_ROOT 2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from DETECT_ROOT (PT0.001S) to DETECT_DISTRO 2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from DETECT_DISTRO (PT0S) to DETECT_SCM 2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from DETECT_SCM (PT0S) to CLOUD_SPECIFIC_CONFIGURE 2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from CLOUD_SPECIFIC_CONFIGURE (PT0S) to REPO_INSTALL 2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA 2018-05-22 16:18:29,484 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT6.003S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:18:30,167 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host 6f0dd6e0-eaf6-4c83-b93a-afe9dc6f24d2: /default 2018-05-22 16:18:30,177 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=3, hostId=6f0dd6e0-eaf6-4c83-b93a-afe9dc6f24d2, hostName=ip-172-31-19-237.ec2.internal}] Added to rack group: /default 2018-05-22 16:18:30,195 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#3) has changed]}. 2018-05-22 16:18:30,196 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence 2018-05-22 16:18:30,196 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check 2018-05-22 16:18:30,219 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles. 2018-05-22 16:18:30,219 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.003S 2018-05-22 16:18:30,219 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms. 2018-05-22 16:18:31,023 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host 92dc8721-6450-4362-9f18-0acea4ad054d: /default 2018-05-22 16:18:31,026 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=4, hostId=92dc8721-6450-4362-9f18-0acea4ad054d, hostName=ip-172-31-26-90.ec2.internal}] Added to rack group: /default 2018-05-22 16:18:31,045 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#4) has changed]}. 2018-05-22 16:18:31,045 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence 2018-05-22 16:18:31,045 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check 2018-05-22 16:18:31,068 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles. 2018-05-22 16:18:31,068 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.003S 2018-05-22 16:18:31,068 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms. 2018-05-22 16:18:31,094 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: New state is a done state 2018-05-22 16:18:31,094 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.021S) to COMPLETE 2018-05-22 16:18:31,094 INFO NodeConfiguratorThread-0-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:18:31,461 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: New state is a done state 2018-05-22 16:18:31,461 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.036S) to COMPLETE 2018-05-22 16:18:31,461 INFO NodeConfiguratorThread-0-6:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:18:31,484 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2S) to INSTALL_JCE 2018-05-22 16:18:31,485 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from INSTALL_JCE (PT0.001S) to AGENT_CONFIGURE 2018-05-22 16:18:31,485 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:18:31,859 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_START (PT0.374S) to SCRIPT_SUCCESS 2018-05-22 16:18:31,859 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:18:32,485 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from TAKE_LOCK (PT42.012S) to DETECT_ROOT 2018-05-22 16:18:32,485 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from DETECT_ROOT (PT0S) to DETECT_DISTRO 2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from DETECT_DISTRO (PT0.001S) to DETECT_SCM 2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from DETECT_SCM (PT0S) to CLOUD_SPECIFIC_CONFIGURE 2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from CLOUD_SPECIFIC_CONFIGURE (PT0S) to REPO_INSTALL 2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA 2018-05-22 16:18:33,052 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host b8f1f4fe-24af-4f89-857d-340ba6668974: /default 2018-05-22 16:18:33,053 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=5, hostId=b8f1f4fe-24af-4f89-857d-340ba6668974, hostName=ip-172-31-28-111.ec2.internal}] Added to rack group: /default 2018-05-22 16:18:33,057 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#5) has changed]}. 2018-05-22 16:18:33,058 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence 2018-05-22 16:18:33,058 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check 2018-05-22 16:18:33,073 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles. 2018-05-22 16:18:33,073 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.003S 2018-05-22 16:18:33,073 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms. 2018-05-22 16:18:33,872 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: New state is a done state 2018-05-22 16:18:33,872 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT2.013S) to COMPLETE 2018-05-22 16:18:33,872 INFO NodeConfiguratorThread-0-7:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:18:58,282 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from REFRESH_METADATA (PT32.013S) to PACKAGE_INSTALL oracle-j2sdk1.7 2018-05-22 16:19:00,283 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:19:02,284 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from REFRESH_METADATA (PT33.008S) to PACKAGE_INSTALL oracle-j2sdk1.7 2018-05-22 16:19:02,811 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2.528S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:19:03,812 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE 2018-05-22 16:19:03,812 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from INSTALL_JCE (PT0S) to AGENT_CONFIGURE 2018-05-22 16:19:03,812 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:19:03,833 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_START (PT0.021S) to SCRIPT_SUCCESS 2018-05-22 16:19:03,833 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:19:04,285 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:19:05,494 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from REFRESH_METADATA (PT33.008S) to PACKAGE_INSTALL oracle-j2sdk1.7 2018-05-22 16:19:05,899 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT1.614S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:19:06,900 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE 2018-05-22 16:19:07,495 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent 2018-05-22 16:19:07,900 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from INSTALL_JCE (PT1S) to AGENT_CONFIGURE 2018-05-22 16:19:07,900 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:19:07,915 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: New state is a done state 2018-05-22 16:19:07,915 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT4.082S) to COMPLETE 2018-05-22 16:19:07,915 INFO NodeConfiguratorThread-0-2:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:19:08,496 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT1.001S) to PACKAGE_INSTALL cloudera-manager-daemons 2018-05-22 16:19:09,709 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_START (PT1.809S) to SCRIPT_SUCCESS 2018-05-22 16:19:09,709 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:19:09,714 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: New state is a done state 2018-05-22 16:19:09,715 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT0.006S) to COMPLETE 2018-05-22 16:19:09,715 INFO NodeConfiguratorThread-0-3:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:19:10,497 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2.001S) to INSTALL_JCE 2018-05-22 16:19:10,497 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from INSTALL_JCE (PT0S) to AGENT_CONFIGURE 2018-05-22 16:19:10,497 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START 2018-05-22 16:19:10,762 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_START (PT0.265S) to SCRIPT_SUCCESS 2018-05-22 16:19:10,762 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT 2018-05-22 16:19:10,768 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: New state is a done state 2018-05-22 16:19:10,768 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT0.006S) to COMPLETE 2018-05-22 16:19:10,768 INFO NodeConfiguratorThread-0-4:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-22 16:19:11,713 INFO CommandPusher:com.cloudera.server.cmf.CommandPusherThread: Failed to update commands in batch mode. java.lang.IllegalStateException: Transaction not active at org.hibernate.ejb.TransactionImpl.getRollbackOnly(TransactionImpl.java:131) at com.cloudera.enterprise.AbstractWrappedEntityManager.commit(AbstractWrappedEntityManager.java:109) at com.cloudera.cmf.persist.CmfEntityManager.commit(CmfEntityManager.java:375) at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:274) at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:189) at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:157) 2018-05-22 16:19:28,436 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (61 skipped) AgentAvroServlet: heartbeat processing stats: average=12ms, min=4ms, max=242ms. 2018-05-22 16:20:28,467 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=8ms, min=4ms, max=242ms. 2018-05-22 16:21:14,142 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands 2018-05-22 16:21:14,160 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-22T20:21:14.143Z to reap. 2018-05-22 16:21:14,161 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators 2018-05-22 16:21:28,514 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=6ms, min=4ms, max=242ms. 2018-05-22 16:22:28,557 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=6ms, min=4ms, max=242ms. 2018-05-22 16:23:28,603 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=5ms, min=4ms, max=242ms. 2018-05-22 16:24:28,656 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=5ms, min=4ms, max=242ms. 2018-05-22 16:25:28,706 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=5ms, min=3ms, max=242ms. 2018-05-22 16:25:44,639 WARN 199025955@scm-web-7:com.cloudera.server.web.cmf.csrf.CsrfRefererInterceptor: Rejecting request originating from 88.14.31.161 for http://ec2-54-210-226-153.compute-1.amazonaws.com:7180/cmf/express-wizard/wizard with referrer null 2018-05-22 16:25:55,001 WARN 62674782@scm-web-9:com.cloudera.server.cmf.tsquery.TimeSeriesQueryService: Could not find a HOST_MONITORING nozzle from SCM. com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM. at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:141) at com.cloudera.server.cmf.tsquery.NozzleRequest.<init>(NozzleRequest.java:50) at com.cloudera.server.cmf.tsquery.TimeSeriesMultiRequest.<init>(TimeSeriesMultiRequest.java:48) at com.cloudera.server.cmf.tsquery.TimeSeriesQueryService.queryTimeSeries(TimeSeriesQueryService.java:516) at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeriesHelper(TimeSeriesQueryController.java:328) at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeries(TimeSeriesQueryController.java:296) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:585) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78) at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Created 05-23-2018 12:35 AM
Hi @nonames
In your log appear this error:
com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM.
The reason if that you didnt install or configure Management Service. You can click on the Management service then configure and add the missing roles.
Try to re-run the upgrade wizard, and at the end of the Manager upgrade the Management service menu will be appear.
Regards,
Manu.
Created on 05-23-2018 04:13 AM - edited 05-23-2018 04:25 AM
Hello @manuroman.
I add all the captures of the errors that I have (I do not really see that they give me information then I do not know where the error can come from):
Log of server:
2018-05-23 06:46:33,462 INFO NodeConfiguratorThread-6-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2018-05-23 06:46:36,442 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:46:38,362 INFO CommandPusher:com.cloudera.server.cmf.CommandPusherThread: Failed to update commands in batch mode. java.lang.IllegalStateException: Transaction not active at org.hibernate.ejb.TransactionImpl.getRollbackOnly(TransactionImpl.java:131) at com.cloudera.enterprise.AbstractWrappedEntityManager.commit(AbstractWrappedEntityManager.java:109) at com.cloudera.cmf.persist.CmfEntityManager.commit(CmfEntityManager.java:375) at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:274) at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:189) at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:157) 2018-05-23 06:47:11,161 INFO 1975182950@scm-web-15:com.cloudera.server.cmf.components.OperationsManagerImpl: Creating cluster cluster with version CDH 5 and rounded off version CDH 5.0.0 2018-05-23 06:47:11,172 INFO 1975182950@scm-web-15:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.cluster (#5) has changed]}. 2018-05-23 06:47:11,172 INFO 1975182950@scm-web-15:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Ejecutar 1 pasos en secuencia 2018-05-23 06:47:11,172 INFO 1975182950@scm-web-15:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Comprobación de configuración obsoleta 2018-05-23 06:47:11,191 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles. 2018-05-23 06:47:11,192 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.004S 2018-05-23 06:47:11,192 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms. 2018-05-23 06:47:16,150 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelManagerImpl: Distributing parcel CDH:5.14.2-1.cdh5.14.2.p0.3 on cluster cluster 2018-05-23 06:47:36,484 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (60 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:48:09,311 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Beginning automatic role assignment 2018-05-23 06:48:09,651 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Ending automatic role assignment 2018-05-23 06:48:09,651 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Beginning service and role creation 2018-05-23 06:48:09,652 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Firing remaining rules 2018-05-23 06:48:09,717 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Extracting config changes 2018-05-23 06:48:09,720 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping input 2018-05-23 06:48:09,720 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt' 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with no members 2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members 2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with kv 'headlamp_heapsize','801112064' 2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064' 2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with kv 'event_server_heapsize','801112064' 2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping output 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_heapsize','801112064' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-BASE' with kv 'event_server_heapsize','801112064' 2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-BASE' with kv 'headlamp_heapsize','801112064' 2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_heapsize','801112064' 2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-input 2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-output 2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Persisting services, role config groups, and roles 2018-05-23 06:48:09,755 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Creating autoconfigs 2018-05-23 06:48:09,761 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Done with service and role creation 2018-05-23 06:48:20,816 INFO 1078180413@scm-web-26:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado. 2018-05-23 06:48:26,270 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully. 2018-05-23 06:48:27,070 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands 2018-05-23 06:48:27,072 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-23T10:48:27.071Z to reap. 2018-05-23 06:48:27,072 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators 2018-05-23 06:48:34,918 INFO 1463824849@scm-web-29:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado. 2018-05-23 06:48:36,266 INFO 462344443@agentServer-7:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=2ms, min=0ms, max=36ms. 2018-05-23 06:48:36,267 INFO 462344443@agentServer-7:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=59ms. 2018-05-23 06:48:36,535 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:48:45,200 INFO 1463824849@scm-web-29:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado. 2018-05-23 06:48:58,384 INFO 1463824849@scm-web-29:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado. 2018-05-23 06:49:36,579 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:50:36,631 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:51:36,683 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:52:36,733 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:53:36,781 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:54:36,818 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:55:36,865 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:56:36,914 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:57:36,964 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:58:27,078 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands 2018-05-23 06:58:27,079 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-23T10:58:27.078Z to reap. 2018-05-23 06:58:27,080 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators 2018-05-23 06:58:36,728 INFO 751747845@agentServer-15:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=1ms, min=0ms, max=29ms. 2018-05-23 06:58:36,728 INFO 751747845@agentServer-15:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=1ms. 2018-05-23 06:58:37,016 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:59:37,063 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 06:59:37,802 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Beginning automatic role assignment 2018-05-23 06:59:37,857 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Ending automatic role assignment 2018-05-23 06:59:37,857 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Beginning service and role creation 2018-05-23 06:59:37,857 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Firing remaining rules 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Extracting config changes 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping input 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt' 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with no members 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with no members 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with no members 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with no members 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with no members 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with kv 'headlamp_heapsize','801112064' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with kv 'event_server_heapsize','801112064' 2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping output 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_heapsize','801112064' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-BASE' with kv 'event_server_heapsize','801112064' 2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-BASE' with kv 'headlamp_heapsize','801112064' 2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968' 2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_heapsize','801112064' 2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-input 2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-output 2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Persisting services, role config groups, and roles 2018-05-23 06:59:37,892 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Creating autoconfigs 2018-05-23 06:59:37,892 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Done with service and role creation 2018-05-23 06:59:41,469 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado. 2018-05-23 06:59:55,834 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado. 2018-05-23 07:00:00,004 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2018-05-23T11:00:00.000Z}. 2018-05-23 07:00:00,009 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.scheduler.CommandDispatcherJob: Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop. 2018-05-23 07:00:37,112 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 07:01:37,166 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms. 2018-05-23 07:02:37,214 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=28ms. 2018-05-23 07:03:37,266 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=28ms. 2018-05-23 07:04:37,306 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=28ms. 2018-05-23 07:05:37,350 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:06:02,799 WARN 962305138@scm-web-31:com.cloudera.server.cmf.tsquery.TimeSeriesQueryService: (16 skipped) Could not find a HOST_MONITORING nozzle from SCM. com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM. at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:141) at com.cloudera.server.cmf.tsquery.NozzleRequest.<init>(NozzleRequest.java:50) at com.cloudera.server.cmf.tsquery.TimeSeriesMultiRequest.<init>(TimeSeriesMultiRequest.java:48) at com.cloudera.server.cmf.tsquery.TimeSeriesQueryService.queryTimeSeries(TimeSeriesQueryService.java:516) at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeriesHelper(TimeSeriesQueryController.java:328) at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeries(TimeSeriesQueryController.java:296) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:585) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78) at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) 2018-05-23 07:06:37,398 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:07:37,445 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:08:27,087 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands 2018-05-23 07:08:27,088 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-23T11:08:27.087Z to reap. 2018-05-23 07:08:27,089 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators 2018-05-23 07:08:37,205 INFO 672099455@agentServer-26:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=1ms, min=0ms, max=37ms. 2018-05-23 07:08:37,205 INFO 672099455@agentServer-26:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=1ms. 2018-05-23 07:08:37,496 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:09:37,545 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:10:37,594 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:11:37,644 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:12:37,692 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:13:37,738 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:14:37,789 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:15:37,839 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms. 2018-05-23 07:16:08,672 INFO 662320811@scm-web-39:com.cloudera.server.web.common.ExceptionReport: Exception report generated accessing http://
java.lang.IllegalArgumentException: Failed to evaluate expression '@authorizer.buttonValue(authentication, #action) or (#action == 'Delete' and @authorizer.deleteHosts(authentication, #hostIds)) or @authorizer.hostCmd(authentication, #action, #hostIds)' at org.springframework.security.access.expression.ExpressionUtils.evaluateAsBoolean(ExpressionUtils.java:13) at org.springframework.security.access.expression.method.ExpressionBasedPreInvocationAdvice.before(ExpressionBasedPreInvocationAdvice.java:41) at org.springframework.security.access.prepost.PreInvocationAuthorizationAdviceVoter.vote(PreInvocationAuthorizationAdviceVoter.java:54) at org.springframework.security.access.prepost.PreInvocationAuthorizationAdviceVoter.vote(PreInvocationAuthorizationAdviceVoter.java:24) at org.springframework.security.access.vote.AffirmativeBased.decide(AffirmativeBased.java:62) at org.springframework.security.access.intercept.AbstractSecurityInterceptor.beforeInvocation(AbstractSecurityInterceptor.java:205) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:59) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:621) at com.cloudera.server.web.cmf.HardwareController$$EnhancerByCGLIB$$9b644eb0.hardwareDispatch(<generated>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:585) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78) at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: org.springframework.expression.spel.SpelEvaluationException: EL1031E:(pos 132): Problem locating method hostCmd cannot on type class com.cloudera.server.cmf.components.Authorizer at org.springframework.expression.spel.ast.MethodReference.findAccessorForMethod(MethodReference.java:181) at org.springframework.expression.spel.ast.MethodReference.getValueInternal(MethodReference.java:107) at org.springframework.expression.spel.ast.CompoundExpression.getValueInternal(CompoundExpression.java:57) at org.springframework.expression.spel.ast.OpOr.getValueInternal(OpOr.java:59) at org.springframework.expression.spel.ast.OpOr.getValueInternal(OpOr.java:1) at org.springframework.expression.spel.ast.SpelNodeImpl.getTypedValue(SpelNodeImpl.java:102) at org.springframework.expression.spel.standard.SpelExpression.getValue(SpelExpression.java:97) at org.springframework.security.access.expression.ExpressionUtils.evaluateAsBoolean(ExpressionUtils.java:11) ... 79 more Caused by: org.springframework.expression.AccessException: Failed to resolve method at org.springframework.expression.spel.support.ReflectiveMethodResolver.resolve(ReflectiveMethodResolver.java:150) at org.springframework.expression.spel.ast.MethodReference.findAccessorForMethod(MethodReference.java:174) ... 86 more Caused by: org.springframework.expression.spel.SpelEvaluationException: EL1033E:(pos 0): Method call of 'hostCmd' is ambiguous, supported type conversions allow multiple variants to match at org.springframework.expression.spel.support.ReflectiveMethodResolver.resolve(ReflectiveMethodResolver.java:141) ... 87 more 2018-05-23 07:16:37,893 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
What do you think?¿ regards and thanks for you help
Created 05-23-2018 05:11 AM
@nonames Go to one of the hosts and look through the /var/log/cloudera-scm-agent/cloudera-scm-agent.log file for any exceptions talking to the CM. Also go to the CM->Hosts tab and check that the agents are heartbeating (under 15 secs each interval).
If the agents are in bad health and not talking to CM then there will no way for the agents to know to fetch a parcel from CM so you must resolve the health issues with the agents to the CM.
Created 05-23-2018 05:48 AM
Friends, I started a new installation (create new EC2 machines and configure them) and now I have no problems with the parcels. Thank you very much @manuroman and @Dan1!!!!!