@sayebogbon  Upgrading Cloudera Manager or CDP can sometimes alter TLS/SSL settings. Please can you verify if TLS/SSL is enabled for the affected services: Navigate to Cloudera Manager > Administration > Security. Confirm that the keystores and truststores for SSL are correctly configured. Validate the keystore and truststore paths in the HDFS configuration: dfs.http.policy dfs.https.enable Please do the above and revert happy hadooping !!!!!     ... View more

Hi @ChethanYM , Thanks for your input. We have managed to resolve the web server issue by disabling the hadoop_secure_web_ui.  The only problem now is when we check the agent status by running systemctl status cloudera-scm-agent, it's reporting urllib.error.HTTPError: HTTP Error 401: Unauthorized as you can see below. The Cloudera support recommend I remove the /opt/rh/rh-python38/root/usr/lib64/python3.8/urllib/request.py   from the rh-python38 so the agent will force its self to use it's own request.py from its python package. However, when I removed it , I was unable to start the agent again. I reported this to them and they had a session with me in which I uninstall and reinstall the agent but nothing works so far. I had installed rh-python38 on our RHE/OL7 system by following this documentation: Installing Python 3.8 standard package on RHEL 7 | CDP Private Cloud. This is python version that the agent is running on Note: the http error is not being reported in the /var/log/cloudera-scm-agen/cloudera-scm-agent.log. It's only reported when I check the status of the agent. Also, only a few hosts (datanode, yarn, hdfs, and some other host) have the issue.     [root@host-exle ~]# systemctl status cloudera-scm-agent ● cloudera-scm-agent.service - Cloudera Manager Agent Service Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-agent.service; enabled; vendor preset: disabled) Active: active (running) since Mon 2024-12-09 19:30:21 GMT; 13h ago Main PID: 18725 (cmagent) CGroup: /system.slice/cloudera-scm-agent.service └─18725 /usr/bin/python3.8 /opt/cloudera/cm-agent/bin/cm agent Dec 09 19:30:33 host-exle cm[18725]: return self._call_chain(*args) Dec 09 19:30:33 host-exle cm[18725]: File "/opt/rh/rh-python38/root/usr/lib64/python3.8/urllib/request.py", line 502, in _call_chain Dec 09 19:30:33 host-exle cm[18725]: result = func(*args) Dec 09 19:30:33 host-exle cm[18725]: File "/opt/cloudera/cm-agent/lib/python3.8/site-packages/cmf/https.py", line 388, in http_error_default Dec 09 19:30:33 host-exle cm[18725]: raise e Dec 09 19:30:33 host-exle cm[18725]: File "/opt/cloudera/cm-agent/lib/python3.8/site-packages/cmf/https.py", line 382, in http_error_default Dec 09 19:30:33 host-exle cm[18725]: return old(self, req, fp, code, msg, hdrs) Dec 09 19:30:33 host-exle cm[18725]: File "/opt/rh/rh-python38/root/usr/lib64/python3.8/urllib/request.py", line 649, in http_error_default Dec 09 19:30:33 host-exle cm[18725]: raise HTTPError(req.full_url, code, msg, hdrs, fp) Dec 09 19:30:33 host-exle cm[18725]: urllib.error.HTTPError: HTTP Error 401: Unauthorized       ... View more

Thanks for getting back. The process_timestamp isn't there. It's not available on other running processes too. I had tried the work around, it didn't work, but I will give it another go. Another thing is the soft link for RegionServer process does not exist in /var/run/cloudera-scm-agent/supervisor/include directory. ... View more

@sayebogbon As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks. ... View more