Reply
Visitor
Posts: 0
Registered: ‎01-23-2019

Error whith distributing parcels during installation

Hello, dear community, I have some problems during istallation CDH6.0.1. On 50 % progress i have following error: 

Error when distributing to my.vm.host.cloud.ru : Src file /cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel does not exist.

I want to install parcels to another directory, mounted by sshfs with name /cloudera3 and available volume few Tb, all files in this directory with owner cloudera-scm. In the file /etc/cloudera-scm-agent/config.ini i registered the corresponding path to parcels directory. I attach some logs. I hope for your help, thanks in advance!

 

Logs cloudera-scm-agent: 

[23/Jan/2019 16:52:42 +0000] 28020 MainThread agent        INFO     Setting default socket timeout to 45
[23/Jan/2019 16:52:42 +0000] 28020 MainThread agent        INFO     Previously active parcels: {}
[23/Jan/2019 16:52:42 +0000] 28020 MainThread agent        INFO     Loading last saved hb response to complete initialization: /var/lib/cloudera-scm-agent/response.avro
[23/Jan/2019 16:52:42 +0000] 28020 Monitor-HostMonitor network_interfaces INFO     NIC iface eth0 doesn't support ETHTOOL (95)
[23/Jan/2019 16:52:42 +0000] 28020 MainThread heartbeat_tracker INFO     HB stats (seconds): num:1 LIFE_MIN:0.04 min:0.04 mean:0.04 max:0.04 LIFE_MAX:0.04
[23/Jan/2019 16:52:42 +0000] 28020 MainThread agent        INFO     CM server guid: 7985b53e-463d-4322-b54d-5b2c608f4ee5
[23/Jan/2019 16:52:42 +0000] 28020 MainThread agent        INFO     Using parcels directory from config.ini value: /cloudera3/parcels
[23/Jan/2019 16:52:42 +0000] 28020 MainThread throttling_logger WARNING  Expected user root for /cloudera3/parcels but was cloudera-scm
[23/Jan/2019 16:52:42 +0000] 28020 MainThread throttling_logger WARNING  Expected group root for /cloudera3/parcels but was cloudera-scm
[23/Jan/2019 16:52:42 +0000] 28020 MainThread parcel       INFO     Agent does not create users/groups and apply file permissions
[23/Jan/2019 16:52:42 +0000] 28020 MainThread downloader   INFO     Downloader path: /cloudera3/parcel-cache
[23/Jan/2019 16:52:42 +0000] 28020 MainThread parcel_cache INFO     Using /cloudera3/parcel-cache for parcel cache
[23/Jan/2019 16:52:42 +0000] 28020 MainThread throttling_logger WARNING  Failed parsing alternatives line: pgsql-reindexdb string index out of range  link currently points to /usr/pgsql-9.4/bin/reindexdb
[23/Jan/2019 16:52:42 +0000] 28020 MainThread agent        INFO     Flood daemon (re)start attempt
[23/Jan/2019 16:52:45 +0000] 28020 MainThread throttling_logger INFO     Identified java component java8 with full version java version "1.8.0_141" Java(TM) SE Runtime Environment (build 1.8.0_141-b15) Java HotSpot(TM) 64-Bit Server VM (build 25.141-b15, mixed mode)  for requested version 8.
[23/Jan/2019 16:52:47 +0000] 28020 Monitor-HostMonitor throttling_logger ERROR    Could not find local file system for /cloudera3/parcels
[23/Jan/2019 16:52:47 +0000] 28020 Monitor-HostMonitor throttling_logger ERROR    chronyc: chronyc sources: not synchronized to any server
[23/Jan/2019 16:53:45 +0000] 28020 MainThread parcel       INFO     Agent does create users/groups and apply file permissions
[23/Jan/2019 16:53:45 +0000] 28020 Thread-13 downloader   INFO     Fetching torrent: http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel.torrent
[23/Jan/2019 16:53:45 +0000] 28020 Thread-13 downloader   INFO     Starting download of: http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel
[23/Jan/2019 16:53:45 +0000] 28020 Thread-13 downloader   INFO     Failed adding torrent: file:///cloudera3/parcel-cache/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel.torrent Already present torrent: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel
[23/Jan/2019 16:53:45 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=0 totalSize=1988378222 upload=0 state=downloading seed=[] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=0]
[23/Jan/2019 16:53:45 +0000] 28020 Thread-13 downloader   INFO     Setting url seed: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel ([])
[23/Jan/2019 16:53:47 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=98046241 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=49309]
[23/Jan/2019 16:53:49 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=213914504 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=107582]
[23/Jan/2019 16:53:51 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=349180197 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=175610]
[23/Jan/2019 16:53:53 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=461897728 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=232298]
[23/Jan/2019 16:53:55 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=567803904 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=285561]
[23/Jan/2019 16:53:57 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=673710080 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=338823]
[23/Jan/2019 16:53:59 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=779091968 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=391822]
[23/Jan/2019 16:54:00 +0000] 28020 MainThread throttling_logger INFO     There is already an active download for http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel
[23/Jan/2019 16:54:01 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=883949568 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=444558]
[23/Jan/2019 16:54:03 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=991952896 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=498875]
[23/Jan/2019 16:54:05 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1098383360 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=552401]
[23/Jan/2019 16:54:07 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1204289536 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=605664]
[23/Jan/2019 16:54:09 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1309671424 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=658663]
[23/Jan/2019 16:54:09 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1309671424 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=658663]
[23/Jan/2019 16:54:11 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1415053312 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=711662]
[23/Jan/2019 16:54:13 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1521483776 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=765188]
[23/Jan/2019 16:54:15 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1627143790 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=818327]
[23/Jan/2019 16:54:17 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1732525678 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=871326]
[23/Jan/2019 16:54:19 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1837383278 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=924061]
[23/Jan/2019 16:54:21 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1943813742 totalSize=1988378222 upload=0 state=downloading seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=977587]
[23/Jan/2019 16:54:23 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1988378222 totalSize=1988378222 upload=0 state=seeding seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=1000000]
[23/Jan/2019 16:54:23 +0000] 28020 Thread-13 downloader   INFO     Completed download of http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel code=200 state=downloaded
[23/Jan/2019 16:54:23 +0000] 28020 Thread-13 parcel_cache WARNING  No checksum in header, skipping verification
[23/Jan/2019 16:54:23 +0000] 28020 Thread-13 parcel_cache INFO     Unpacking /cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel into /cloudera3/parcels
[23/Jan/2019 16:57:48 +0000] 28020 Thread-13 throttling_logger ERROR    Error while unpacking /cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel
Traceback (most recent call last):
  File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel_cache.py", line 194, in cb
    unpack_parcel(op.path, unpack_dir, self.path)
  File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel_cache.py", line 220, in unpack_parcel
    raise Exception("Untar failed with return code: %d, with tar output:\n stdout: [%s],\n stderr: [%s]" % (return_code, output[0], output[1]))
Exception: Untar failed with return code: 2, with tar output:
 stdout: [],
 stderr: [tar: CDH-6.0.1-1.cdh6.0.1.p0.590678/lib/hadoop-yarn/hadoop-yarn-server-tests.jar: Cannot utime: No such file or directory
tar: CDH-6.0.1-1.cdh6.0.1.p0.590678/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar: Cannot utime: No such file or directory
tar: CDH-6.0.1-1.cdh6.0.1.p0.590678/lib/hadoop-yarn/hadoop-yarn-client.jar: Cannot utime: No such file or directory
tar: ...........

[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 downloader   INFO     Fetching torrent: http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel.torrent
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 downloader   INFO     Starting download of: http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 downloader   INFO     Failed adding torrent: file:///cloudera3/parcel-cache/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel.torrent Already present torrent: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 downloader   INFO     Current state: CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel [totalDownloaded=1988378222 totalSize=1988378222 upload=0 state=seeding seed=['http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel'] location=/cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel progress=1000000]
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 downloader   INFO     Completed download of http://my.vm.host.cloud.ru:7180/cmf/parcel/download/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel code=200 state=downloaded
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 parcel_cache WARNING  No checksum in header, skipping verification
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 parcel_cache INFO     Unpacking /cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel into /cloudera3/parcels
[23/Jan/2019 16:58:00 +0000] 28020 Thread-13 downloader   ERROR    Failed op: Src file /cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel does not exist
Traceback (most recent call last):
  File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/downloader.py", line 502, in callable
    callback(url, curr_op)
  File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel_cache.py", line 200, in cb
    raise e
Exception: Src file /cloudera3/parcels/.flood/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel does not exist

 

Highlighted
Posts: 984
Kudos: 115
Solutions: 61
Registered: ‎04-06-2015

Re: Error whith distributing parcels during installation

While you wait for a more knowledgable community member to repond, here is a link to documentation around parcels in CDH 6.1 which may be helpful.

 

Additional information you can provide for those who may answer your question:

 

Is there a particular reason you have chosen CDH 6.0.1? 

Are you using Cloudera Manager? 



Cy Jervis, Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum