question CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent in Archives of Support Questions (Read Only)

CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

vikash145 — Fri, 14 Jul 2017 13:21:59 GMT

Tried to install latest CDH on Centos 7.2. After CDH finished downloading, distribution stucks forever infact it didn't start. Free space is not a issue.

Below is the log message in the scm-agent log file.

Thread-13 downloader INFO Current state: CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel [totalDownloaded=0 totalSize=1702423659 upload=0 state=downloading seed=['http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel'] location=/opt/cloudera/parcels/.flood/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel progress=0]

Is there any config issue ?

Thanks

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

mbigelow — Fri, 14 Jul 2017 17:41:08 GMT

From the hosts are you able to access CM over port 7180. Try access the CM url using curl -v to try to get more information. The 0 progress indicates that it is trying but failing to download it from the CM server to the cluster hosts.

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

vikash145 — Fri, 14 Jul 2017 17:55:56 GMT

curl -v http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel > /dev/null
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to compute-15 port 7180 (#0)
* Trying fe80::230:48ff:fedf:ae2c...
* Connection refused
* Trying fe80::230:48ff:fedf:ae2d...
* Connection refused
* Trying 192.168.200.15...
* Connected to compute-15 (192.168.200.15) port 7180 (#0)
> GET /cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel HTTP/1.1
> User-Agent: curl/7.29.0
> Host: compute-15:7180
> Accept: */*
>
< HTTP/1.1 200 OK
< Expires: Thu, 01-Jan-1970 00:00:00 GMT
< Set-Cookie: CLOUDERA_MANAGER_SESSIONID=1ha3awbsj6mp2t23bq7725qsp;Path=/;HttpOnly
< Content-Type: application/x-download; charset=UTF-8
< Content-Length: 1702423659
< Content-disposition: attachment; filename="CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel"
< CM-Parcel-Checksum: fa704f42b8da8916409c3f52f189629152ba2839
< Server: Jetty(6.1.26.cloudera.4)
<
{ [data not shown]
100 1623M 100 1623M 0 0 51.5M 0 0:00:31 0:00:31 --:--:-- 50.0M
* Connection #0 to host compute-15 left intact

wget http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel
--2017-07-14 13:48:01-- http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel
Resolving compute-15 (compute-15)... fe80::230:48ff:fedf:ae2c, fe80::230:48ff:fedf:ae2d, 192.168.200.15, ...
Connecting to compute-15 (compute-15)|fe80::230:48ff:fedf:ae2c|:7180... failed: Connection refused.
Connecting to compute-15 (compute-15)|fe80::230:48ff:fedf:ae2d|:7180... failed: Connection refused.
Connecting to compute-15 (compute-15)|192.168.200.15|:7180... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1702423659 (1.6G) [application/x-download]
Saving to: ‘CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel’

100%[=========================================================================================================>] 1,70,24,23,659 50.0MB/s in 31s

2017-07-14 13:48:32 (51.6 MB/s) - ‘CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel’ saved [1702423659/1702423659]

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

mbigelow — Fri, 14 Jul 2017 17:59:29 GMT

Both commands show that it is trying over IPv6 first and then by IP. The former fails with a connection refused while the latter succeeds. I would disable IPv6 on all hosts but for this it can just be the CM host, and then try again.

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

vikash145 — Sat, 15 Jul 2017 14:21:45 GMT

Thanks mbigelow ,

After I disabled IPv6 the distribution issue got resolved. But I am still getting some other issue. Will post in other thread.