Remote Parcel Repository URLs" is always initialized

[#1]

Hi

We use Cloudera in the environment without internet access

These URLs added on Parcel Repository & Network Settings :

• https://archive.cloudera.com/accumulo-c5/parcels/latest/
• https://archive.cloudera.com/accumulo6/6.1/parcels/
• https://archive.cloudera.com/kafka/parcels/latest/
• http://archive.cloudera.com/kudu/parcels/latest/

Someone know how to remove these URLs using the CM API ?

Best Regards,

[#2]

Hi

We use Cloudera in the environment without internet access

These URLs added on Parcel Repository & Network Settings :

• https://archive.cloudera.com/accumulo-c5/parcels/latest/
• https://archive.cloudera.com/accumulo6/6.1/parcels/
• https://archive.cloudera.com/kafka/parcels/latest/
• http://archive.cloudera.com/kudu/parcels/latest/

Someone know how to remove these URLs using the CM API ?

Best Regards,

[#3]

Hello @abdebja ,

yes its possible to remove the Default remote parcel urls via API (i assume you dont want to do the UI way which is simple and Easy )

First fetch the Configs of cloudera Manager via GET command 

curl -X GET "http://akhil01.novalocal:7180/api/v49/cm/config?view=summary" -H "accept: application/json"

The response will have the REMOTE_PARCEL_REPO_URLS which we need to find out and correct and do a same PUT command which will update the urls . 

for ex : 

do a GET 

curl -X GET "http://akhil01.novalocal:7180/api/v49/cm/config?view=summary" -H "accept: application/json"


{
  "items": [
    
    {
      "name": "PROXYUSER_KNOX_HOSTS",
      "value": "*",
      "sensitive": false
    },
    {
      "name": "PROXYUSER_KNOX_USERS",
      "value": "*",
      "sensitive": false
    },
    {
      "name": "REMOTE_PARCEL_REPO_URLS",
      "value": "https://archive.cloudera.com/p/cdh7/7.1.8.0/parcels,http://cloudera-build-4-us-west-1.vpc.cloudera.com/s3/build/11800998/cfm/2.x/redhat7/yum/tars/parcel,https://archive.cloudera.com/p/cdh6/{latest_supported}/parcels/,https://archive.cloudera.com/cdh6/{latest_supported}/parcels/,https://archive.cloudera.com/p/cdh5/parcels/latest,https://archive.cloudera.com/kafka/parcels/latest/,https://archive.cloudera.com/p/cdsw1/1.10.0/parcels/,https://archive.cloudera.com/p/cfm2/2.1.4.1000/redhat7/yum/tars/parcel,https://archive.cloudera.com/p/spark3/3.3.7180.0/parcels/,http://cloudera-build-us-west-1.vpc.cloudera.com/s3/build/32427494/cdh/7.x/parcels/",
      "sensitive": false
    }
  ]
}

Now do a PUT 

curl -X PUT "http://akhil01.novalocal:7180/api/v49/cm/config?message=Test" -H "accept: application/json" -H "Content-Type: application/json" -d "{ \"items\": [ { \"name\": \"REMOTE_PARCEL_REPO_URLS\", \"value\": \"https://archive.cloudera.com/p/cdh7/7.1.8.0/parcels,https://archive.cloudera.com/p/cdsw1/1.10.0/parcels/,https://archive.cloudera.com/p/cfm2/2.1.4.1000/redhat7/yum/tars/parcel,https://archive.cloudera.com/p/spark3/3.3.7180.0/parcels/,http://cloudera-build-us-west-1.vpc.cloudera.com/s3/build/32427494/cdh/7.x/parcels/\", \"sensitive\": false } ]}"

You can Make use of API explorer in CM which can be accessed via : http://CM-Server:port/static/apidocs/ui/index.html#/ClouderaManagerResource/updateConfig

or

https://archive.cloudera.com/cm-public/7.3.0-9851987/generic/jar/cm_api/apidocs/ui/index.html#/Cloud...

to get the Exact API and more details as needed. 

[#4]

Hello @akhilsnaik ,

Thank you for the proposed solution, it works, however, when restarting the cloudera manager the URLs come back in Parcel Repository & Network Settings. so as if nothing has changed

[#5]

Hello @abdebja ,

that is strange. may i please know if you are deleting all the repos or are you keeping local repo url intact in this setting. 

if possible please provide your Put curl masking the cm-server, u/p and secret details so that I can reproduce the same 

[#6 · Accepted solution]

Hello @akhilsnaik ,

I understand where the problem comes from.
Automatically Install CSD Repo URLs is by default set to true,
If set to true, Cloudera Manager will automatically scan CSDs and add these URLs to the list of parcel repo URLs on every startup of Cloudera Manager.

As i want only custom URLs to be present in the list. i set the value to false.

curl -X PUT "https://local:7183/api/v45/cm/config?message=no%20csd%20repo" -H  "accept: application/json" -H  "Content-Type: application/json" -d "{  \"items\": [    {      \"name\": \"PARCEL_INSTALL_CSD_REPO_URLS\",      \"value\": \"false\",      \"sensitive\": false    }  ]}"

 Now after restarting cloudera manager only my local repository which was initialized

regards,

[#7]

@abdebja   , Great in that case let me know if we are good to Close the Thread , Please accept your last comment as Accept as Solution.