Failure to Install Embedded Container Service (ECS), encountering "Failed to reconcile with temporary etcd" after manual uninstallation

[#1]

Hi everyone, I would like some clarification. Thank you.

During the installation of ECS, we encountered some errors that prevented successful installation. One of the issues was as follows: the Certificate Signing Request (CSR) remained in an "approved" state instead of being "certificated," causing it to remain stuck in a loop.

Following the steps outlined in the "Manually uninstalling ECS from a cluster" and "Configuring a containerized cluster with SELinux" documents helped us overcome this issue.

# /var/lib/rancher/rke2/bin/kubectl --kubeconfig /etc/rancher/rke2/rke2.yaml get csr
No resources found

However, we encountered another problem:

time="2024-03-27T02:37:24-04:00" level=info msg="etcd temporary data store connection OK"
time="2024-03-27T02:37:24-04:00" level=info msg="Reconciling bootstrap data between datastore and disk"
time="2024-03-27T02:37:24-04:00" level=fatal msg="Failed to reconcile with temporary etcd: bootstrap data already found and encrypted with different token"

After deleting the etcd path on the Rancher master, we were able to proceed past this issue.

rm -f -r /var/lib/rancher/rke2/server/db/etcd-tmp/
rm -f -r /var/lib/rancher/rke2/server/db/etcd/

Is deleting the etcd path a safe and viable solution? Or are there other considerations or alternative methods to address this problem?

[#2 · Accepted solution]

Hello @steinsgate 

Thanks for bringing up this issue

Yes as part of uninstallation, we need to remove the rancher directories as well. Currently, this was missing from the documentation but now will be added soon. 

rm -rf /var/lib/rancher/*

So as part of  uninstallation, it should be done and should be safe

[#3]

Hello @upadhyayk04 

Thank you very much for your response.
After reinstalling, we encountered this issue.

https://community.cloudera.com/t5/Support-Questions/Failure-to-Install-Embedded-Container-Service-EC...
Could you please take a look at it when you have some free time? Thank you.