Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Solved Go to solution

CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Contributor

Tried to install latest CDH on Centos 7.2. After CDH finished downloading, distribution stucks forever infact it didn't start. Free space is not a  issue. 

 

Below is the log message in the scm-agent log file.

 

Thread-13 downloader INFO Current state: CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel [totalDownloaded=0 totalSize=1702423659 upload=0 state=downloading seed=['http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel'] location=/opt/cloudera/parcels/.flood/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel progress=0]

 

Is there any config issue ?

 

Thanks

 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Champion
Both commands show that it is trying over IPv6 first and then by IP. The former fails with a connection refused while the latter succeeds. I would disable IPv6 on all hosts but for this it can just be the CM host, and then try again.
4 REPLIES 4

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Champion

From the hosts are you able to access CM over port 7180.  Try access the CM url using curl -v to try to get more information.  The 0 progress indicates that it is trying but failing to download it from the CM server to the cluster hosts.

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Contributor

curl -v http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel > /dev/null
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to compute-15 port 7180 (#0)
* Trying fe80::230:48ff:fedf:ae2c...
* Connection refused
* Trying fe80::230:48ff:fedf:ae2d...
* Connection refused
* Trying 192.168.200.15...
* Connected to compute-15 (192.168.200.15) port 7180 (#0)
> GET /cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel HTTP/1.1
> User-Agent: curl/7.29.0
> Host: compute-15:7180
> Accept: */*
>
< HTTP/1.1 200 OK
< Expires: Thu, 01-Jan-1970 00:00:00 GMT
< Set-Cookie: CLOUDERA_MANAGER_SESSIONID=1ha3awbsj6mp2t23bq7725qsp;Path=/;HttpOnly
< Content-Type: application/x-download; charset=UTF-8
< Content-Length: 1702423659
< Content-disposition: attachment; filename="CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel"
< CM-Parcel-Checksum: fa704f42b8da8916409c3f52f189629152ba2839
< Server: Jetty(6.1.26.cloudera.4)
<
{ [data not shown]
100 1623M 100 1623M 0 0 51.5M 0 0:00:31 0:00:31 --:--:-- 50.0M
* Connection #0 to host compute-15 left intact

 

 

 

 

 

 

wget http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel
--2017-07-14 13:48:01-- http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel
Resolving compute-15 (compute-15)... fe80::230:48ff:fedf:ae2c, fe80::230:48ff:fedf:ae2d, 192.168.200.15, ...
Connecting to compute-15 (compute-15)|fe80::230:48ff:fedf:ae2c|:7180... failed: Connection refused.
Connecting to compute-15 (compute-15)|fe80::230:48ff:fedf:ae2d|:7180... failed: Connection refused.
Connecting to compute-15 (compute-15)|192.168.200.15|:7180... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1702423659 (1.6G) [application/x-download]
Saving to: ‘CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel’

100%[=========================================================================================================>] 1,70,24,23,659 50.0MB/s in 31s

2017-07-14 13:48:32 (51.6 MB/s) - ‘CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel’ saved [1702423659/1702423659]

 

 

 

 

 

Highlighted

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Champion
Both commands show that it is trying over IPv6 first and then by IP. The former fails with a connection refused while the latter succeeds. I would disable IPv6 on all hosts but for this it can just be the CM host, and then try again.

Re: CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

Contributor
Thanks mbigelow ,

After I disabled IPv6 the distribution issue got resolved. But I am still getting some other issue. Will post in other thread.