Support Questions

Find answers, ask questions, and share your expertise

CDH - 5.12.0 distribution process failed - Failure due to stall on seeded torrent

avatar
Contributor

Tried to install latest CDH on Centos 7.2. After CDH finished downloading, distribution stucks forever infact it didn't start. Free space is not a  issue. 

 

Below is the log message in the scm-agent log file.

 

Thread-13 downloader INFO Current state: CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel [totalDownloaded=0 totalSize=1702423659 upload=0 state=downloading seed=['http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel'] location=/opt/cloudera/parcels/.flood/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel progress=0]

 

Is there any config issue ?

 

Thanks

 

1 ACCEPTED SOLUTION

avatar
Champion
Both commands show that it is trying over IPv6 first and then by IP. The former fails with a connection refused while the latter succeeds. I would disable IPv6 on all hosts but for this it can just be the CM host, and then try again.

View solution in original post

4 REPLIES 4

avatar
Champion

From the hosts are you able to access CM over port 7180.  Try access the CM url using curl -v to try to get more information.  The 0 progress indicates that it is trying but failing to download it from the CM server to the cluster hosts.

avatar
Contributor

curl -v http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel > /dev/null
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to compute-15 port 7180 (#0)
* Trying fe80::230:48ff:fedf:ae2c...
* Connection refused
* Trying fe80::230:48ff:fedf:ae2d...
* Connection refused
* Trying 192.168.200.15...
* Connected to compute-15 (192.168.200.15) port 7180 (#0)
> GET /cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel HTTP/1.1
> User-Agent: curl/7.29.0
> Host: compute-15:7180
> Accept: */*
>
< HTTP/1.1 200 OK
< Expires: Thu, 01-Jan-1970 00:00:00 GMT
< Set-Cookie: CLOUDERA_MANAGER_SESSIONID=1ha3awbsj6mp2t23bq7725qsp;Path=/;HttpOnly
< Content-Type: application/x-download; charset=UTF-8
< Content-Length: 1702423659
< Content-disposition: attachment; filename="CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel"
< CM-Parcel-Checksum: fa704f42b8da8916409c3f52f189629152ba2839
< Server: Jetty(6.1.26.cloudera.4)
<
{ [data not shown]
100 1623M 100 1623M 0 0 51.5M 0 0:00:31 0:00:31 --:--:-- 50.0M
* Connection #0 to host compute-15 left intact

 

 

 

 

 

 

wget http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel
--2017-07-14 13:48:01-- http://compute-15:7180/cmf/parcel/download/CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel
Resolving compute-15 (compute-15)... fe80::230:48ff:fedf:ae2c, fe80::230:48ff:fedf:ae2d, 192.168.200.15, ...
Connecting to compute-15 (compute-15)|fe80::230:48ff:fedf:ae2c|:7180... failed: Connection refused.
Connecting to compute-15 (compute-15)|fe80::230:48ff:fedf:ae2d|:7180... failed: Connection refused.
Connecting to compute-15 (compute-15)|192.168.200.15|:7180... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1702423659 (1.6G) [application/x-download]
Saving to: ‘CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel’

100%[=========================================================================================================>] 1,70,24,23,659 50.0MB/s in 31s

2017-07-14 13:48:32 (51.6 MB/s) - ‘CDH-5.12.0-1.cdh5.12.0.p0.29-el7.parcel’ saved [1702423659/1702423659]

 

 

 

 

 

avatar
Champion
Both commands show that it is trying over IPv6 first and then by IP. The former fails with a connection refused while the latter succeeds. I would disable IPv6 on all hosts but for this it can just be the CM host, and then try again.

avatar
Contributor
Thanks mbigelow ,

After I disabled IPv6 the distribution issue got resolved. But I am still getting some other issue. Will post in other thread.