How to stop auto distribution of parcel when adding host to cloudera cluster.

Hello @ishashrestha 

Thank you for reaching out to the Cloudera community

Are you adding the hosts through the Cloudera Wizard? Can you try adding the host manually to Cloudera Manager which means just install the packages and configure the config.ini

Usually, the parcels will be downloaded based on the configuration in /var/lib/cloudera-scm-agent/active_parcels.json

@upadhyayk04 I am adding a host through the API (using Ansible), but even when I add it manually, it starts distributing.
My current /var/lib/cloudera-scm-agent/active_parcels.json contains the required parcel:
{"CDH": "7.1.9-1.cdh7.1.9.p0.44702451"}

Thanks, @ishashrestha for the update. What happens if you remove the parcel link from the file I mean, keep is empty ideally, it would pick it up automatically and try the distribute the parcels. The way to skip it would be add the host to Cloudera Manager and not the cluster as adding it to cluster will try to enable the activated parcels 

Thank you for the response @upadhyayk04 . To clarify, I have a baked image that already includes Cloudera Manager, the agent, and the parcel. The hosts are already added in Cloudera Manager, and after that, they are added to my cluster. However, my requirement is for them to be added as parcel-ready. The problem is that it defeats the purpose when Cloudera Manager starts redistributing the parcel again. I was wondering if there’s a solution to this.

@ishashrestha Cloudera Manager tracks parcel state centrally in its DB (AVAILABLE_REMOTELY, DOWNLOADED, DISTRIBUTED, ACTIVATED, etc.).So even if the parcel bits are already present on the host, Agent will redistribute it.Also managing parcels is agents responsibility.It performs a lot of background tasks in parcel lifecycle.

In Distribution phase it compares the .sha file (from the repo) with the .parcel file in the cache.This ensures no corruption or mismatch and then extracts parcel (.parcel is tarball).

In activation phase creates/update symlinks in parcel directory, /etc/alternatives and in /var/lib/alternatives.Also creates service users which is needed service installation.

If any of these don’t line up, CM will re-trigger distribution/activation even if the bits are there.

@ishashrestha Did the response assist in resolving your query? If it did, please mark the relevant reply as the solution, as it will help others locate the answer more easily in the future.

Hello

Copying a parcel to a node and adding the node to the cluster does not mean Cloudera Manager will recognize that the parcel is already present and skip distribution. Cloudera Manager manages parcel distribution through its centralized management system. When a node is added to the cluster, Cloudera Manager will handle the parcel distribution process according to its internal procedures, ensuring that the correct and complete parcel metadata and components are properly configured and unpacked on the node.

This process ensures consistency and reliability in the cluster configuration. Therefore, even if a parcel is manually copied to a node, Cloudera Manager is likely to still perform its distribution process for verification and consistency purposes.

Copying the parcels to the nodes before adding them to the cluster is not the proper or suggested way to do it, therefore not supported.

The recommended method would be to distribute the parcels by using the Wizard as usual as Cloudera supports the parcel distribution through the UI only.

I hope this helps.

@ishashrestha, please let us know if you have any further queries regarding the details shared above.