Answer
Visitor
Posts: 2
Registered: ‎09-12-2017
Accepted Solution
Freeze while activating the CDH Parcels
[ Edited ]

Hi There,

 

I was trying setting up CM/CDH 6 Beta version. I am facing problem at 'Install Parcels' Step where CM goes in an infinite loop of Downloading parcels.

parcel_download_in_loop.png

CM logs are below. It says the something about the expected size of the Parcel. I thought the parcel might have been corrupt. But when I tried with a totally fresh downloaded parcel, it goes in same loop.

 

2018-07-04 12:31:31,608 WARN New I/O worker #15:com.cloudera.parcel.components.ParcelDownloaderImpl: Downloaded 2750238720 bytes but expected only 1928953221 bytes for CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel.
2018-07-04 12:31:31,608 INFO New I/O worker #15:com.cloudera.parcel.components.ParcelDownloaderImpl: Completed download of: http://localhost/cdh6/CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel
2018-07-04 12:31:47,645 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelManagerImpl: Downloading parcels of CDH:6.0.0-1.cdh6.0.0.p0.339140 for distros [RHEL7]
2018-07-04 12:31:47,646 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Preparing to download: http://localhost/cdh6/CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel
2018-07-04 12:31:55,192 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (3 skipped) AgentAvroServlet: heartbeat processing stats: average=10ms, min=5ms, max=126ms.
2018-07-04 12:32:33,082 WARN New I/O worker #17:com.cloudera.parcel.components.ParcelDownloaderImpl: Downloaded 2750238720 bytes but expected only 1928953221 bytes for CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel.

 

Any thoughts?

 

Thanks,

Naresh

Accepted Solution
Cloudera Employee
Posts: 1
Registered: ‎05-18-2018
Answered

Hi Naresh,

 

The problem is related to a bug fix in CM6 such that it no longer ignores the "Content-Encoding" header sent by the HTTP server.  Unfortunately we have found that Apache httpd defaults to setting this header incorrectly when transmitting the parcel files.  CM server believes the parcel file has been compressed by httpd and tries to decompress it.

 

Previously this did not affect CM because it ignored the "Content-Encoding" header.

 

The fix for this is:

  1. Edit the file called /etc/httpd/conf/httpd.conf on the host running Apache httpd.
  2. Find the section called <IfModule mime_module> within the file.
  3. Add or update the following line within that section:
    AddType application/x-gzip .gz .tgz .parcel

Save the file and restart Apache httpd.  You may need to restart CM server.  The parcels should now download properly.  We have updated the CM6 docs with this information.

 

br,

Harshy

 

Other Answers: 0