07-03-2018 05:40 PM - edited 07-03-2018 05:42 PM
I was trying setting up CM/CDH 6 Beta version. I am facing problem at 'Install Parcels' Step where CM goes in an infinite loop of Downloading parcels.
CM logs are below. It says the something about the expected size of the Parcel. I thought the parcel might have been corrupt. But when I tried with a totally fresh downloaded parcel, it goes in same loop.
2018-07-04 12:31:31,608 WARN New I/O worker #15:com.cloudera.parcel.components.ParcelDownloaderImpl: Downloaded 2750238720 bytes but expected only 1928953221 bytes for CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel.
2018-07-04 12:31:31,608 INFO New I/O worker #15:com.cloudera.parcel.components.ParcelDownloaderImpl: Completed download of: http://localhost/cdh6/CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel
2018-07-04 12:31:47,645 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelManagerImpl: Downloading parcels of CDH:6.0.0-1.cdh6.0.0.p0.339140 for distros [RHEL7]
2018-07-04 12:31:47,646 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Preparing to download: http://localhost/cdh6/CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel
2018-07-04 12:31:55,192 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (3 skipped) AgentAvroServlet: heartbeat processing stats: average=10ms, min=5ms, max=126ms.
2018-07-04 12:32:33,082 WARN New I/O worker #17:com.cloudera.parcel.components.ParcelDownloaderImpl: Downloaded 2750238720 bytes but expected only 1928953221 bytes for CDH-6.0.0-1.cdh6.0.0.p0.339140-el7.parcel.
on 07-12-2018 05:53 PM
The problem is related to a bug fix in CM6 such that it no longer ignores the "Content-Encoding" header sent by the HTTP server. Unfortunately we have found that Apache httpd defaults to setting this header incorrectly when transmitting the parcel files. CM server believes the parcel file has been compressed by httpd and tries to decompress it.
Previously this did not affect CM because it ignored the "Content-Encoding" header.
The fix for this is:
AddType application/x-gzip .gz .tgz .parcel
Save the file and restart Apache httpd. You may need to restart CM server. The parcels should now download properly. We have updated the CM6 docs with this information.