Valid license but no new Parcels available in CM

[#1]

We have a valid license and and login to the paywall, which I have tested by using parcel URLs in a browser and from the command line (Ubuntu) with wget. Both show I can obtain a directory listing from behind the paywall.

However, despite entering this URL in the configuration for the Parcel window in CM, I still do not see new available parcels. We are on 6.3.1 on one cluster and 6.3.2 on another, it's the same for both, no new parcels listed. We presumably should see at least 6.3.4, if not 6.3.3 as well.

I first tried with the URL format given by the documentation (obviously replacing username:password with our actual info), and a slightly different URL I was given in a support ticket I raised. I get no errors, but still no new parcels showing as available.

Has anyone else experienced this?

[#2]

@hurryUpHarry Are you able to download them manually using curl or wget from command line? Also what if you open that URL with your credentials are you able to see the pckges on the website? 

[#3 · Accepted solution]

Hi,

Thanks for the reply.

Yes as I mention I have complete access through a browser to navigate around the filesystem as it is presented.

I was able to download the 'index.html' page using wget, so I assume I would be able to download other items using wget.

Since posting the above I went and looked at the logs on disk. It was complaining about not being able to see the file manifest.json, a 404 was being returned.

So I went back to the browser and clicked around until I found that file, and used that URL, which was:

https://<REDACTED>@archive.cloudera.com/p/cdh6/6.3.4/parcels/

When I saved that in CM, the new parcel became immediately available. I have not seen that URL given in any documentation. Though that said, the documentation under

https://docs.cloudera.com/documentation/enterprise/upgrade/topics/ug_cdh_upgrade.html

contains a link that states:

For more information, see Updating an existing CDH/Cloudera Manager deployment to access downloads with authentication.

in a section about the paywall. If you follow that link, you will get a 404. I raised this in my ticket and was told instead to go to:

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/cm-retrofit-auth-downloads...

which led me here:

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cm_6_version_download.h...

which gives this version of the URL:

https://<login>archive.cloudera.com/p/cm6/6.3.4/ubuntu1804/apt/

which is different again, and seems to reference CM as opposed to CDH. I don't think I can effectively test this link in my clusters as I already have the parcels downloaded via the other URL that I had worked out manually.

I'm surprised given all the above that this problem hasn't been reported already. I saw lots of tickets from people who were no longer able to access the parcels after the paywall went up, either because they didn't have a license or had not yet obtained their paywall login, but nothing reporting this problem. Perhaps there is some different way I should have gone about it, but all my attempts were via the online docs and the support personnel, and in the end I had to sort it out by myself.

[#4]

@hurryUpHarry The URL you are using is giving expected results because that URL is explicitly for CM repo and says "Cloudera Manager 6 Version and Download Information".

If you need CDH download information then you have to go one step next on same page for example notice the left side bar. 

This consist the CDH repo information. 

Also this page : https://docs.cloudera.com/documentation/enterprise/6/6.0/topics/cm-retrofit-auth-downloads.html looks correct to me there seems no discrepancy. Would you mind what issue you are seeing here so that I can pass the feedback. 

[#5]

Hello,

Not sure what URL you're referring to, but as mentioned in my original post, after googling for the documentation I found myself here:

https://docs.cloudera.com/documentation/enterprise/upgrade/topics/ug_cdh_upgrade.html

"Upgrading the CDH Cluster"

It had the link "Updating an existing CDH/Cloudera Manager deployment to access downloads with authentication." - which was broken, giving a 404.

I raised a ticket with Cloudera support and told them all of this. I was given an alternative URL to try - not the one that ended up working, and which did not work.

I found the link myself and have since upgraded 2 clusters. After seeing your update here today, I went back to the original page I was looking at:

https://docs.cloudera.com/documentation/enterprise/upgrade/topics/ug_cdh_upgrade.html

And see now that the link has been fixed, maybe because of my ticket in which I requested as much. The page that I now arrive at does indeed contain the correct link that I had previously found manually.

Therefore there is no longer any issue, but if you want to pass some feedback then "thanks for fixing the broken link" will probably do!

Thanks again for you attention to this thread, it is appreciated.

[#6]

Do you have any proxy/firewall in your network? Have you added the details in the CM proxy configuration?

I suspect a network/proxy issue.

[#7]

Not a network/proxy issue. As described in my original post I had no problem with the URL in a browser or using wget.

The problem is with Cloudera's documentation.