Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Problem whith the installation of parcels

avatar
Explorer

Hello,

I am novice in the installation of CDH. I need to install CDH in 5 instances EC2 of AWS.

But I have a problem whith the parcels in the step number 4:Error.jpg

 

 

Any idea?¿ I don´t know what I to do about it. Thanks for your help.

 

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Hi @nonames,

 

I could be for more than one reasons. 

 

Can you show us, any logs?

 

Veo que dispones de Cloduera en Español, por si lo prefieres. Puedes intentar hacer click en los botones rojos que te aparecen justo debajo (como aparece en tu imagen) algo más de detalle se te muestra.

 

 

Regards,

Manu.

View solution in original post

6 REPLIES 6

avatar
Expert Contributor

Hi @nonames,

 

I could be for more than one reasons. 

 

Can you show us, any logs?

 

Veo que dispones de Cloduera en Español, por si lo prefieres. Puedes intentar hacer click en los botones rojos que te aparecen justo debajo (como aparece en tu imagen) algo más de detalle se te muestra.

 

 

Regards,

Manu.

avatar
Explorer

Hi @manuroman thanks for you help.I include the manager server log (sorry but it is very long):

Regards

 

Spoiler
PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:18:22,420 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT1.244S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:18:22,421 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT1.220S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:18:22,481 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from REFRESH_METADATA (PT32.007S) to PACKAGE_INSTALL oracle-j2sdk1.7
2018-05-22 16:18:23,279 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT1.017S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:18:23,481 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT1S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:18:24,201 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:18:24,421 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2.001S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:18:24,421 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:18:25,279 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2S) to INSTALL_JCE
2018-05-22 16:18:25,280 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from INSTALL_JCE (PT0.001S) to AGENT_CONFIGURE
2018-05-22 16:18:25,280 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:18:25,422 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE
2018-05-22 16:18:25,422 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from INSTALL_JCE (PT0S) to AGENT_CONFIGURE
2018-05-22 16:18:25,422 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:18:25,733 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_START (PT0.453S) to SCRIPT_SUCCESS
2018-05-22 16:18:25,733 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:18:25,925 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from AGENT_START (PT0.503S) to SCRIPT_SUCCESS
2018-05-22 16:18:25,926 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:18:26,202 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2.001S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from TAKE_LOCK (PT36.007S) to DETECT_ROOT
2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from DETECT_ROOT (PT0S) to DETECT_DISTRO
2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from DETECT_DISTRO (PT0S) to DETECT_SCM
2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from DETECT_SCM (PT0S) to CLOUD_SPECIFIC_CONFIGURE
2018-05-22 16:18:26,269 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from CLOUD_SPECIFIC_CONFIGURE (PT0S) to REPO_INSTALL
2018-05-22 16:18:26,270 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA
2018-05-22 16:18:26,422 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2.001S) to INSTALL_JCE
2018-05-22 16:18:26,423 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from INSTALL_JCE (PT0.001S) to AGENT_CONFIGURE
2018-05-22 16:18:26,423 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:18:27,203 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE
2018-05-22 16:18:28,072 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from INSTALL_JCE (PT0.868S) to AGENT_CONFIGURE
2018-05-22 16:18:28,072 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0.001S) to AGENT_START
2018-05-22 16:18:28,073 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from AGENT_START (PT0.001S) to SCRIPT_SUCCESS
2018-05-22 16:18:28,073 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:18:28,319 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: AgentAvroServlet: heartbeat processing stats: average=8ms, min=8ms, max=8ms.
2018-05-22 16:18:28,425 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_START (PT1.999S) to SCRIPT_SUCCESS
2018-05-22 16:18:28,425 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0.003S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:18:28,466 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host fa42d1c5-8343-4b3c-b295-033320f166f8: /default
2018-05-22 16:18:28,590 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=1, hostId=fa42d1c5-8343-4b3c-b295-033320f166f8, hostName=ip-172-31-26-30.ec2.internal}] Added to rack group: /default
2018-05-22 16:18:28,616 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#1) has changed]}.
2018-05-22 16:18:28,616 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence
2018-05-22 16:18:28,616 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check
2018-05-22 16:18:28,638 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles.
2018-05-22 16:18:28,639 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.004S 
2018-05-22 16:18:28,639 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms.
2018-05-22 16:18:28,643 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host 1de1e66a-16f1-4cd0-af94-f99ce59f7d4c: /default
2018-05-22 16:18:28,644 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=2, hostId=1de1e66a-16f1-4cd0-af94-f99ce59f7d4c, hostName=ip-172-31-21-217.ec2.internal}] Added to rack group: /default
2018-05-22 16:18:28,655 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#2) has changed]}.
2018-05-22 16:18:28,655 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence
2018-05-22 16:18:28,655 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check
2018-05-22 16:18:28,684 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles.
2018-05-22 16:18:28,685 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.004S 
2018-05-22 16:18:28,685 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms.
2018-05-22 16:18:28,759 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: New state is a done state
2018-05-22 16:18:28,759 INFO NodeConfiguratorThread-0-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.026S) to COMPLETE
2018-05-22 16:18:28,759 INFO NodeConfiguratorThread-0-5:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:18:28,944 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: New state is a done state
2018-05-22 16:18:28,944 INFO NodeConfiguratorThread-0-1:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-21-217.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.019S) to COMPLETE
2018-05-22 16:18:28,944 INFO NodeConfiguratorThread-0-1:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from TAKE_LOCK (PT39.007S) to DETECT_ROOT
2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from DETECT_ROOT (PT0.001S) to DETECT_DISTRO
2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from DETECT_DISTRO (PT0S) to DETECT_SCM
2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from DETECT_SCM (PT0S) to CLOUD_SPECIFIC_CONFIGURE
2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from CLOUD_SPECIFIC_CONFIGURE (PT0S) to REPO_INSTALL
2018-05-22 16:18:29,276 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA
2018-05-22 16:18:29,484 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT6.003S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:18:30,167 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host 6f0dd6e0-eaf6-4c83-b93a-afe9dc6f24d2: /default
2018-05-22 16:18:30,177 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=3, hostId=6f0dd6e0-eaf6-4c83-b93a-afe9dc6f24d2, hostName=ip-172-31-19-237.ec2.internal}] Added to rack group: /default
2018-05-22 16:18:30,195 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#3) has changed]}.
2018-05-22 16:18:30,196 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence
2018-05-22 16:18:30,196 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check
2018-05-22 16:18:30,219 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles.
2018-05-22 16:18:30,219 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.003S 
2018-05-22 16:18:30,219 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms.
2018-05-22 16:18:31,023 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host 92dc8721-6450-4362-9f18-0acea4ad054d: /default
2018-05-22 16:18:31,026 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=4, hostId=92dc8721-6450-4362-9f18-0acea4ad054d, hostName=ip-172-31-26-90.ec2.internal}] Added to rack group: /default
2018-05-22 16:18:31,045 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#4) has changed]}.
2018-05-22 16:18:31,045 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence
2018-05-22 16:18:31,045 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check
2018-05-22 16:18:31,068 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles.
2018-05-22 16:18:31,068 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.003S 
2018-05-22 16:18:31,068 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms.
2018-05-22 16:18:31,094 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: New state is a done state
2018-05-22 16:18:31,094 INFO NodeConfiguratorThread-0-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-19-237.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.021S) to COMPLETE
2018-05-22 16:18:31,094 INFO NodeConfiguratorThread-0-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:18:31,461 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: New state is a done state
2018-05-22 16:18:31,461 INFO NodeConfiguratorThread-0-6:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT3.036S) to COMPLETE
2018-05-22 16:18:31,461 INFO NodeConfiguratorThread-0-6:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:18:31,484 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2S) to INSTALL_JCE
2018-05-22 16:18:31,485 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from INSTALL_JCE (PT0.001S) to AGENT_CONFIGURE
2018-05-22 16:18:31,485 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:18:31,859 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_START (PT0.374S) to SCRIPT_SUCCESS
2018-05-22 16:18:31,859 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:18:32,485 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from TAKE_LOCK (PT42.012S) to DETECT_ROOT
2018-05-22 16:18:32,485 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from DETECT_ROOT (PT0S) to DETECT_DISTRO
2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from DETECT_DISTRO (PT0.001S) to DETECT_SCM
2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from DETECT_SCM (PT0S) to CLOUD_SPECIFIC_CONFIGURE
2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from CLOUD_SPECIFIC_CONFIGURE (PT0S) to REPO_INSTALL
2018-05-22 16:18:32,486 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA
2018-05-22 16:18:33,052 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: Setting default rackId for host b8f1f4fe-24af-4f89-857d-340ba6668974: /default
2018-05-22 16:18:33,053 INFO avro-servlet-hb-processor-0:com.cloudera.server.cmf.AgentProtocolImpl: [DbHost{id=5, hostId=b8f1f4fe-24af-4f89-857d-340ba6668974, hostName=ip-172-31-28-111.ec2.internal}] Added to rack group: /default
2018-05-22 16:18:33,057 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.name (#5) has changed]}.
2018-05-22 16:18:33,058 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Execute 1 steps in sequence
2018-05-22 16:18:33,058 INFO avro-servlet-hb-processor-0:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Configuration Staleness Check
2018-05-22 16:18:33,073 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles.
2018-05-22 16:18:33,073 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.003S 
2018-05-22 16:18:33,073 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms.
2018-05-22 16:18:33,872 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: New state is a done state
2018-05-22 16:18:33,872 INFO NodeConfiguratorThread-0-7:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT2.013S) to COMPLETE
2018-05-22 16:18:33,872 INFO NodeConfiguratorThread-0-7:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:18:58,282 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from REFRESH_METADATA (PT32.013S) to PACKAGE_INSTALL oracle-j2sdk1.7
2018-05-22 16:19:00,283 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:19:02,284 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from REFRESH_METADATA (PT33.008S) to PACKAGE_INSTALL oracle-j2sdk1.7
2018-05-22 16:19:02,811 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT2.528S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:19:03,812 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE
2018-05-22 16:19:03,812 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from INSTALL_JCE (PT0S) to AGENT_CONFIGURE
2018-05-22 16:19:03,812 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:19:03,833 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from AGENT_START (PT0.021S) to SCRIPT_SUCCESS
2018-05-22 16:19:03,833 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:19:04,285 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:19:05,494 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from REFRESH_METADATA (PT33.008S) to PACKAGE_INSTALL oracle-j2sdk1.7
2018-05-22 16:19:05,899 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT1.614S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:19:06,900 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT1.001S) to INSTALL_JCE
2018-05-22 16:19:07,495 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL oracle-j2sdk1.7 (PT2.001S) to PACKAGE_INSTALL cloudera-manager-agent
2018-05-22 16:19:07,900 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from INSTALL_JCE (PT1S) to AGENT_CONFIGURE
2018-05-22 16:19:07,900 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:19:07,915 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: New state is a done state
2018-05-22 16:19:07,915 INFO NodeConfiguratorThread-0-2:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-30.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT4.082S) to COMPLETE
2018-05-22 16:19:07,915 INFO NodeConfiguratorThread-0-2:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:19:08,496 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-agent (PT1.001S) to PACKAGE_INSTALL cloudera-manager-daemons
2018-05-22 16:19:09,709 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from AGENT_START (PT1.809S) to SCRIPT_SUCCESS
2018-05-22 16:19:09,709 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:19:09,714 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: New state is a done state
2018-05-22 16:19:09,715 INFO NodeConfiguratorThread-0-3:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-26-90.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT0.006S) to COMPLETE
2018-05-22 16:19:09,715 INFO NodeConfiguratorThread-0-3:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:19:10,497 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from PACKAGE_INSTALL cloudera-manager-daemons (PT2.001S) to INSTALL_JCE
2018-05-22 16:19:10,497 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from INSTALL_JCE (PT0S) to AGENT_CONFIGURE
2018-05-22 16:19:10,497 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_CONFIGURE (PT0S) to AGENT_START
2018-05-22 16:19:10,762 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from AGENT_START (PT0.265S) to SCRIPT_SUCCESS
2018-05-22 16:19:10,762 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from SCRIPT_SUCCESS (PT0S) to WAIT_FOR_HEARTBEAT
2018-05-22 16:19:10,768 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: New state is a done state
2018-05-22 16:19:10,768 INFO NodeConfiguratorThread-0-4:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-31-28-111.ec2.internal: Transitioning from WAIT_FOR_HEARTBEAT (PT0.006S) to COMPLETE
2018-05-22 16:19:10,768 INFO NodeConfiguratorThread-0-4:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-22 16:19:11,713 INFO CommandPusher:com.cloudera.server.cmf.CommandPusherThread: Failed to update commands in batch mode.
java.lang.IllegalStateException: Transaction not active
	at org.hibernate.ejb.TransactionImpl.getRollbackOnly(TransactionImpl.java:131)
	at com.cloudera.enterprise.AbstractWrappedEntityManager.commit(AbstractWrappedEntityManager.java:109)
	at com.cloudera.cmf.persist.CmfEntityManager.commit(CmfEntityManager.java:375)
	at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:274)
	at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:189)
	at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:157)
2018-05-22 16:19:28,436 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (61 skipped) AgentAvroServlet: heartbeat processing stats: average=12ms, min=4ms, max=242ms.
2018-05-22 16:20:28,467 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=8ms, min=4ms, max=242ms.
2018-05-22 16:21:14,142 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2018-05-22 16:21:14,160 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-22T20:21:14.143Z to reap.
2018-05-22 16:21:14,161 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2018-05-22 16:21:28,514 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=6ms, min=4ms, max=242ms.
2018-05-22 16:22:28,557 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=6ms, min=4ms, max=242ms.
2018-05-22 16:23:28,603 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=5ms, min=4ms, max=242ms.
2018-05-22 16:24:28,656 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=5ms, min=4ms, max=242ms.
2018-05-22 16:25:28,706 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=5ms, min=3ms, max=242ms.
2018-05-22 16:25:44,639 WARN 199025955@scm-web-7:com.cloudera.server.web.cmf.csrf.CsrfRefererInterceptor: Rejecting request originating from 88.14.31.161 for http://ec2-54-210-226-153.compute-1.amazonaws.com:7180/cmf/express-wizard/wizard with referrer null
2018-05-22 16:25:55,001 WARN 62674782@scm-web-9:com.cloudera.server.cmf.tsquery.TimeSeriesQueryService: Could not find a HOST_MONITORING nozzle from SCM.
com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM.
	at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:141)
	at com.cloudera.server.cmf.tsquery.NozzleRequest.<init>(NozzleRequest.java:50)
	at com.cloudera.server.cmf.tsquery.TimeSeriesMultiRequest.<init>(TimeSeriesMultiRequest.java:48)
	at com.cloudera.server.cmf.tsquery.TimeSeriesQueryService.queryTimeSeries(TimeSeriesQueryService.java:516)
	at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeriesHelper(TimeSeriesQueryController.java:328)
	at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeries(TimeSeriesQueryController.java:296)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176)
	at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436)
	at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424)
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790)
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669)
	at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:585)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
	at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78)
	at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
	at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
	at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

 

avatar
Expert Contributor

Hi @nonames

 

In your log appear this error: 

com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM.

 

The reason if that you didnt install or configure Management Service. You can click on the Management service then configure and add the missing roles.

Try to re-run the upgrade wizard, and at the end of the Manager upgrade the Management service menu will be appear. 

 

 

Regards,

Manu.

avatar
Explorer

Hello @manuroman.

I add all the captures of the errors that I have (I do not really see that they give me information then I do not know where the error can come from):


El estado del host es incorrectoEl estado del host es incorrecto

 

No se puede agregar ningún rol nuevoNo se puede agregar ningún rol nuevo

 

No se ha podidio comprobar la conexión con la base de datos para ver si el host está en buen estadoNo se ha podidio comprobar la conexión con la base de datos para ver si el host está en buen estado

 

I see that anyhost to have has assigned rolesI see that anyhost to have has assigned roles

 Log of  server:

Spoiler
2018-05-23 06:46:33,462 INFO NodeConfiguratorThread-6-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2018-05-23 06:46:36,442 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:46:38,362 INFO CommandPusher:com.cloudera.server.cmf.CommandPusherThread: Failed to update commands in batch mode.
java.lang.IllegalStateException: Transaction not active
	at org.hibernate.ejb.TransactionImpl.getRollbackOnly(TransactionImpl.java:131)
	at com.cloudera.enterprise.AbstractWrappedEntityManager.commit(AbstractWrappedEntityManager.java:109)
	at com.cloudera.cmf.persist.CmfEntityManager.commit(CmfEntityManager.java:375)
	at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:274)
	at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:189)
	at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:157)
2018-05-23 06:47:11,161 INFO 1975182950@scm-web-15:com.cloudera.server.cmf.components.OperationsManagerImpl: Creating cluster cluster with version CDH 5 and rounded off version CDH 5.0.0
2018-05-23 06:47:11,172 INFO 1975182950@scm-web-15:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.cluster (#5) has changed]}.
2018-05-23 06:47:11,172 INFO 1975182950@scm-web-15:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Ejecutar 1 pasos en secuencia
2018-05-23 06:47:11,172 INFO 1975182950@scm-web-15:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Comprobación de configuración obsoleta
2018-05-23 06:47:11,191 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Running staleness check with QUICK_CHECK for 0/0 roles.
2018-05-23 06:47:11,192 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.004S 
2018-05-23 06:47:11,192 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check execution stats: average=0ms, min=0ms, max=0ms.
2018-05-23 06:47:16,150 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelManagerImpl: Distributing parcel CDH:5.14.2-1.cdh5.14.2.p0.3 on cluster cluster
2018-05-23 06:47:36,484 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (60 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:48:09,311 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Beginning automatic role assignment
2018-05-23 06:48:09,651 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Ending automatic role assignment
2018-05-23 06:48:09,651 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Beginning service and role creation
2018-05-23 06:48:09,652 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Firing remaining rules
2018-05-23 06:48:09,717 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Extracting config changes
2018-05-23 06:48:09,720 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping input
2018-05-23 06:48:09,720 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt'
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with no members
2018-05-23 06:48:09,721 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members
2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with kv 'headlamp_heapsize','801112064'
2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064'
2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with kv 'event_server_heapsize','801112064'
2018-05-23 06:48:09,722 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping output
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_heapsize','801112064'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-BASE' with kv 'event_server_heapsize','801112064'
2018-05-23 06:48:09,725 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-BASE' with kv 'headlamp_heapsize','801112064'
2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_heapsize','801112064'
2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-input
2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-output
2018-05-23 06:48:09,726 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Persisting services, role config groups, and roles
2018-05-23 06:48:09,755 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Creating autoconfigs
2018-05-23 06:48:09,761 INFO 1144541858@scm-web-28:com.cloudera.server.cmf.cluster.RulesCluster: Done with service and role creation
2018-05-23 06:48:20,816 INFO 1078180413@scm-web-26:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado.
2018-05-23 06:48:26,270 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully.
2018-05-23 06:48:27,070 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2018-05-23 06:48:27,072 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-23T10:48:27.071Z to reap.
2018-05-23 06:48:27,072 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2018-05-23 06:48:34,918 INFO 1463824849@scm-web-29:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado.
2018-05-23 06:48:36,266 INFO 462344443@agentServer-7:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=2ms, min=0ms, max=36ms.
2018-05-23 06:48:36,267 INFO 462344443@agentServer-7:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=59ms.
2018-05-23 06:48:36,535 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:48:45,200 INFO 1463824849@scm-web-29:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado.
2018-05-23 06:48:58,384 INFO 1463824849@scm-web-29:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado.
2018-05-23 06:49:36,579 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:50:36,631 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:51:36,683 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:52:36,733 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:53:36,781 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:54:36,818 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:55:36,865 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:56:36,914 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:57:36,964 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:58:27,078 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2018-05-23 06:58:27,079 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-23T10:58:27.078Z to reap.
2018-05-23 06:58:27,080 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2018-05-23 06:58:36,728 INFO 751747845@agentServer-15:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=1ms, min=0ms, max=29ms.
2018-05-23 06:58:36,728 INFO 751747845@agentServer-15:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=1ms.
2018-05-23 06:58:37,016 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:59:37,063 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 06:59:37,802 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Beginning automatic role assignment
2018-05-23 06:59:37,857 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Ending automatic role assignment
2018-05-23 06:59:37,857 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Beginning service and role creation
2018-05-23 06:59:37,857 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Firing remaining rules
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Extracting config changes
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping input
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt'
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with no members
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with no members
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with no members
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,878 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with no members
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with no members
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661' with kv 'headlamp_heapsize','801112064'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661' with kv 'event_server_heapsize','801112064'
2018-05-23 06:59:37,879 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661' with kv 'firehose_heapsize','801112064'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping output
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Service 'mgmt'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-HOSTMONITOR-BASE' with members 'mgmt-HOSTMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-TELEMETRYPUBLISHER-BASE' with no members
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-EVENTSERVER-BASE' with members 'mgmt-EVENTSERVER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATORMETASERVER-BASE' with no members
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ACTIVITYMONITOR-BASE' with no members
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-REPORTSMANAGER-BASE' with members 'mgmt-REPORTSMANAGER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-NAVIGATOR-BASE' with no members
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-SERVICEMONITOR-BASE' with members 'mgmt-SERVICEMONITOR-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Group 'mgmt-ALERTPUBLISHER-BASE' with members 'mgmt-ALERTPUBLISHER-06f38b443bbef7d7fe474340b75c1661'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-HOSTMONITOR-BASE' with kv 'firehose_heapsize','801112064'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-EVENTSERVER-BASE' with kv 'event_server_heapsize','801112064'
2018-05-23 06:59:37,881 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-REPORTSMANAGER-BASE' with kv 'headlamp_heapsize','801112064'
2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_non_java_memory_bytes','1041235968'
2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Config for group 'mgmt-SERVICEMONITOR-BASE' with kv 'firehose_heapsize','801112064'
2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-input
2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.RoleConfigGroupMerger: Dumping directive-output
2018-05-23 06:59:37,882 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Persisting services, role config groups, and roles
2018-05-23 06:59:37,892 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Creating autoconfigs
2018-05-23 06:59:37,892 INFO 1600531335@scm-web-27:com.cloudera.server.cmf.cluster.RulesCluster: Done with service and role creation
2018-05-23 06:59:41,469 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado.
2018-05-23 06:59:55,834 INFO 1600531335@scm-web-27:com.cloudera.cmf.model.DbCommand: Command null(RepMgrTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:No se ha podido comprobar la conexión de base de datos para ver si el host no está en buen estado.
2018-05-23 07:00:00,004 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2018-05-23T11:00:00.000Z}.
2018-05-23 07:00:00,009 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.scheduler.CommandDispatcherJob: Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop.
2018-05-23 07:00:37,112 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 07:01:37,166 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=3ms, min=2ms, max=35ms.
2018-05-23 07:02:37,214 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=28ms.
2018-05-23 07:03:37,266 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=28ms.
2018-05-23 07:04:37,306 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=28ms.
2018-05-23 07:05:37,350 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:06:02,799 WARN 962305138@scm-web-31:com.cloudera.server.cmf.tsquery.TimeSeriesQueryService: (16 skipped) Could not find a HOST_MONITORING nozzle from SCM.
com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM.
	at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:141)
	at com.cloudera.server.cmf.tsquery.NozzleRequest.<init>(NozzleRequest.java:50)
	at com.cloudera.server.cmf.tsquery.TimeSeriesMultiRequest.<init>(TimeSeriesMultiRequest.java:48)
	at com.cloudera.server.cmf.tsquery.TimeSeriesQueryService.queryTimeSeries(TimeSeriesQueryService.java:516)
	at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeriesHelper(TimeSeriesQueryController.java:328)
	at com.cloudera.server.web.cmf.charts.TimeSeriesQueryController.queryTimeSeries(TimeSeriesQueryController.java:296)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176)
	at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436)
	at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424)
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790)
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669)
	at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:585)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
	at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78)
	at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
	at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
	at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125)
	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
	at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
2018-05-23 07:06:37,398 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:07:37,445 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:08:27,087 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2018-05-23 07:08:27,088 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2016-05-23T11:08:27.087Z to reap.
2018-05-23 07:08:27,089 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2018-05-23 07:08:37,205 INFO 672099455@agentServer-26:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=1ms, min=0ms, max=37ms.
2018-05-23 07:08:37,205 INFO 672099455@agentServer-26:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=1ms.
2018-05-23 07:08:37,496 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:09:37,545 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:10:37,594 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:11:37,644 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:12:37,692 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:13:37,738 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:14:37,789 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:15:37,839 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.
2018-05-23 07:16:08,672 INFO 662320811@scm-web-39:com.cloudera.server.web.common.ExceptionReport: Exception report generated accessing http://

java.lang.IllegalArgumentException: Failed to evaluate expression '@authorizer.buttonValue(authentication, #action) or (#action == 'Delete' and @authorizer.deleteHosts(authentication, #hostIds)) or @authorizer.hostCmd(authentication, #action, #hostIds)' at org.springframework.security.access.expression.ExpressionUtils.evaluateAsBoolean(ExpressionUtils.java:13) at org.springframework.security.access.expression.method.ExpressionBasedPreInvocationAdvice.before(ExpressionBasedPreInvocationAdvice.java:41) at org.springframework.security.access.prepost.PreInvocationAuthorizationAdviceVoter.vote(PreInvocationAuthorizationAdviceVoter.java:54) at org.springframework.security.access.prepost.PreInvocationAuthorizationAdviceVoter.vote(PreInvocationAuthorizationAdviceVoter.java:24) at org.springframework.security.access.vote.AffirmativeBased.decide(AffirmativeBased.java:62) at org.springframework.security.access.intercept.AbstractSecurityInterceptor.beforeInvocation(AbstractSecurityInterceptor.java:205) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:59) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:621) at com.cloudera.server.web.cmf.HardwareController$$EnhancerByCGLIB$$9b644eb0.hardwareDispatch(<generated>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:585) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78) at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: org.springframework.expression.spel.SpelEvaluationException: EL1031E:(pos 132): Problem locating method hostCmd cannot on type class com.cloudera.server.cmf.components.Authorizer at org.springframework.expression.spel.ast.MethodReference.findAccessorForMethod(MethodReference.java:181) at org.springframework.expression.spel.ast.MethodReference.getValueInternal(MethodReference.java:107) at org.springframework.expression.spel.ast.CompoundExpression.getValueInternal(CompoundExpression.java:57) at org.springframework.expression.spel.ast.OpOr.getValueInternal(OpOr.java:59) at org.springframework.expression.spel.ast.OpOr.getValueInternal(OpOr.java:1) at org.springframework.expression.spel.ast.SpelNodeImpl.getTypedValue(SpelNodeImpl.java:102) at org.springframework.expression.spel.standard.SpelExpression.getValue(SpelExpression.java:97) at org.springframework.security.access.expression.ExpressionUtils.evaluateAsBoolean(ExpressionUtils.java:11) ... 79 more Caused by: org.springframework.expression.AccessException: Failed to resolve method at org.springframework.expression.spel.support.ReflectiveMethodResolver.resolve(ReflectiveMethodResolver.java:150) at org.springframework.expression.spel.ast.MethodReference.findAccessorForMethod(MethodReference.java:174) ... 86 more Caused by: org.springframework.expression.spel.SpelEvaluationException: EL1033E:(pos 0): Method call of 'hostCmd' is ambiguous, supported type conversions allow multiple variants to match at org.springframework.expression.spel.support.ReflectiveMethodResolver.resolve(ReflectiveMethodResolver.java:141) ... 87 more 2018-05-23 07:16:37,893 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (59 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=2ms, max=36ms.

What do you think?¿ regards and thanks for you help

avatar
Contributor

@nonames Go to one of the hosts and look through the /var/log/cloudera-scm-agent/cloudera-scm-agent.log file for any exceptions talking to the CM. Also go to the CM->Hosts tab and check that the agents are heartbeating (under 15 secs each interval).

 

If the agents are in bad health and not talking to CM then there will no way for the agents to know to fetch a parcel from CM so you must resolve the health issues with the agents to the CM.

avatar
Explorer

Friends, I started a new installation (create new EC2 machines and configure them) and now I have no problems with the parcels. Thank you very much @manuroman and @Dan1!!!!!