Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Stuck downloading parcel

Highlighted

Stuck downloading parcel

New Contributor

Hi Everyone,

 

I'm trying to perform adding of host via the API but I'm stuck somewhere. I can see from the logs that the host was added. 

 

cm_host_install succeeded
Adding {'ip': '10.0.0.6', 'hostname': 'datanodesc01.3vfdwvfpjo4u3dh0zxq4iyqyfe.bx.internal.cloudapp.net', 'hostId': 'eb43c201-248e-4fa2-9925-fe96e172b4c7'}
Available parcels:
        KAFKA 3.0.0-1.3.0.0.p0.40
        ACCUMULO 1.4.4-1.cdh4.5.0.p0.65
        ACCUMULO 1.7.2-5.5.0.ACCUMULO5.5.0.p0.8
        CDH 5.13.0-1.cdh5.13.0.p0.29
        SQOOP_TERADATA_CONNECTOR 1.6c5
        SQOOP_NETEZZA_CONNECTOR 1.5c5
        SPARK 0.9.0-1.cdh4.6.0.p0.98
        KUDU 1.4.0-1.cdh5.12.1.p0.10
Starting parcel download. This might take a while.

cloudera-scm-agent.log of the hosts being added

 

root@datanodesc01 cloudera-scm-agent]# tail -f cloudera-scm-agent.log
[23/Oct/2017 12:49:44 +0000] 34544 MainThread parcel_cache INFO     Using /opt/cloudera/parcel-cache for parcel cache
[23/Oct/2017 12:49:44 +0000] 34544 MainThread agent        INFO     Flood daemon (re)start attempt
[23/Oct/2017 12:49:45 +0000] 34544 MainThread agent        INFO     Triggering supervisord update.
[23/Oct/2017 12:49:46 +0000] 34544 MainThread firehoses    INFO     Reporting interval updated: 5.0 -> 60
[23/Oct/2017 12:49:46 +0000] 34544 MainThread agent        INFO     Active parcel list updated; recalculating component info.
[23/Oct/2017 12:49:46 +0000] 34544 MainThread throttling_logger INFO     Identified java component java6 with full version JAVA_HOME=/usr/java/default java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version misc.
[23/Oct/2017 12:49:46 +0000] 34544 MainThread throttling_logger INFO     Identified java component java6 with full version JAVA_HOME=/usr/java/jdk1.6.0_31 java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version 6.
[23/Oct/2017 12:49:46 +0000] 34544 MainThread throttling_logger INFO     Identified java component java7 with full version JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)  for requested version 7.
[23/Oct/2017 12:50:44 +0000] 34544 MonitorDaemon-Reporter firehoses    INFO     Creating a connection to the SERVICEMONITOR.
[23/Oct/2017 12:50:44 +0000] 34544 MonitorDaemon-Reporter firehoses    INFO     Creating a connection to the HOSTMONITOR.
[23/Oct/2017 12:59:47 +0000] 34544 MainThread heartbeat_tracker INFO     HB stats (seconds): num:41 LIFE_MIN:0.04 min:0.01 mean:0.04 max:0.05 LIFE_MAX:0.05

Cloudera Manager Log

 

2017-10-23 12:58:58,087 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files CDH-5.13.0-1.cdh5.13.0.p0.29-el6.parcel under /opt/cloudera/parcel-repo
2017-10-23 12:59:17,700 INFO avro-servlet-hb-processor-3:com.cloudera.server.common.AgentAvroServlet: (11 skipped) AgentAvroServlet: heartbeat processing stats: average=14ms, min=2ms, max=39ms.
2017-10-23 12:59:29,451 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2017-10-23 12:59:29,452 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2015-10-24T17:59:29.451Z to reap.
2017-10-23 12:59:29,453 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2017-10-23 12:59:29,453 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 1 requests.
2017-10-23 12:59:38,630 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully.
2017-10-23 13:00:00,006 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2017-10-23T18:00:00.000Z}.
2017-10-23 13:00:00,295 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.scheduler.CommandDispatcherJob: Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop.
2017-10-23 13:00:17,430 INFO 526491690@agentServer-20:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=7ms, min=0ms, max=35ms.
2017-10-23 13:00:17,431 INFO 526491690@agentServer-20:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=1ms.
2017-10-23 13:00:17,756 INFO avro-servlet-hb-processor-3:com.cloudera.server.common.AgentAvroServlet: (11 skipped) AgentAvroServlet: heartbeat processing stats: average=14ms, min=2ms, max=39ms.
2017-10-23 13:01:17,807 INFO avro-servlet-hb-processor-3:com.cloudera.server.common.AgentAvroServlet: (11 skipped) AgentAvroServlet: heartbeat processing stats: average=14ms, min=2ms, max=39ms.
2017-10-23 13:02:17,862 INFO avro-servlet-hb-processor-3:com.cloudera.server.common.AgentAvroServlet: (11 skipped) AgentAvroServlet: heartbeat processing stats: average=14ms, min=2ms, max=38ms.
2017-10-23 13:03:17,908 INFO avro-servlet-hb-processor-3:com.cloudera.server.common.AgentAvroServlet: (11 skipped) AgentAvroServlet: heartbeat processing stats: average=14ms, min=2ms, max=38ms.
2017-10-23 13:04:17,946 INFO avro-servlet-hb-processor-3:com.cloudera.server.common.AgentAvroServlet: (11 skipped) AgentAvroServlet: heartbeat processing stats: average=14ms, min=2ms, max=38ms.

Not sure where else to look, appreciate any assistance.Thanks in advance

1 REPLY 1

Re: Stuck downloading parcel

Super Collaborator

Based on the information provided, I can tell you're using the CM API python example [0],

the next step of the script is to auto assign/configure roles [1].

 

Per your subject 'Stuck downloading parcel' also, based on your info 'I can see from the logs that the host was added.'

 

Can you let me know what is the state in the CM UI, CM> Hosts> Parcels and CM> 'All Recent Commands' do you see if the parcels Downloaded/Available or currently deploying, are there any errors in all recent commands? 

 

You could also check this [2] CM API based deployment.

 

Let me know if this helps.

 

Best,

Michalis

 

[0] https://github.com/cloudera/cm_api/blob/cm5-5.13.0/python/examples

[1] https://github.com/cloudera/cm_api/blob/cm5-5.13.0/python/examples/cluster_set_up.py#L96-L100

[2] https://github.com/gdgt/cmapi

Don't have an account?
Coming from Hortonworks? Activate your account here