Valid license but no new Parcels available in CM

Question

We have a valid license and and login to the paywall, which I have tested by using parcel URLs in a browser and from the command line (Ubuntu) with wget. Both show I can obtain a directory listing from behind the paywall.

However, despite entering this URL in the configuration for the Parcel window in CM, I still do not see new available parcels. We are on 6.3.1 on one cluster and 6.3.2 on another, it's the same for both, no new parcels listed. We presumably should see at least 6.3.4, if not 6.3.3 as well.

I first tried with the URL format given by the documentation (obviously replacing username:password with our actual info), and a slightly different URL I was given in a support ticket I raised. I get no errors, but still no new parcels showing as available.

Has anyone else experienced this?

hurryUpHarry · Accepted Answer

Hi,

Thanks for the reply.

Yes as I mention I have complete access through a browser to navigate around the filesystem as it is presented.

I was able to download the 'index.html' page using wget, so I assume I would be able to download other items using wget.

Since posting the above I went and looked at the logs on disk. It was complaining about not being able to see the file manifest.json, a 404 was being returned.

So I went back to the browser and clicked around until I found that file, and used that URL, which was:

https://<REDACTED>@archive.cloudera.com/p/cdh6/6.3.4/parcels/

When I saved that in CM, the new parcel became immediately available. I have not seen that URL given in any documentation. Though that said, the documentation under

https://docs.cloudera.com/documentation/enterprise/upgrade/topics/ug_cdh_upgrade.html

contains a link that states:

For more information, see Updating an existing CDH/Cloudera Manager deployment to access downloads with authentication.

in a section about the paywall. If you follow that link, you will get a 404. I raised this in my ticket and was told instead to go to:

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/cm-retrofit-auth-downloads.html

which led me here:

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cm_6_version_download.html#cm_6_version_download

which gives this version of the URL:

https://<login>archive.cloudera.com/p/cm6/6.3.4/ubuntu1804/apt/

which is different again, and seems to reference CM as opposed to CDH. I don't think I can effectively test this link in my clusters as I already have the parcels downloaded via the other URL that I had worked out manually.

I'm surprised given all the above that this problem hasn't been reported already. I saw lots of tickets from people who were no longer able to access the parcels after the paywall went up, either because they didn't have a license or had not yet obtained their paywall login, but nothing reporting this problem. Perhaps there is some different way I should have gone about it, but all my attempts were via the online docs and the support personnel, and in the end I had to sort it out by myself.

GangWar · Answer

@hurryUpHarry Are you able to download them manually using curl or wget from command line? Also what if you open that URL with your credentials are you able to see the pckges on the website?

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.