Created on 12-11-2020 10:53 AM - edited 09-16-2022 07:39 AM
Need Help here!.
Keep getting follow messages in cloudera-scm-agent log and noticed it deletes everything from
/etc/hadoop/ and puts back the content every minute -
This is causing some Mapreduce tasks to fail with File not found errors.
Created 01-09-2021 07:58 AM
@Anks2411 This could be a bug since it's an older CM version but looking at the logs this seems issue with alternatives.
Can you try these steps and let me know if this improves the behaviour.
1. Stop all roles on the host.
2. Stop the agent.
3. Ensure that the agent and supervisord are fully stopped.
4. Verify the output of the follow command and ensure that it only captures information related to cloudera.
\ls -l /etc/alternatives/ | grep "\/opt\/cloudera"
5. Run the following shell script to cleanup and remove all alternatives related to cloudera parcels.
$ \ls -l /etc/alternatives/ | grep "\/opt\/cloudera" | awk {'print $9'} | \
while read m; do if [[ -e /var/lib/alternatives/${m} ]] ;then echo "Removing ${m}"; \
rm -fv /var/lib/alternatives/${m} ; fi; rm -fv /etc/alternatives/${m}; done
6. Start the agent and review the log data in /var/log/cloudera-scm-agent/cloudera-scm-agent.log. You should see the agent attempt to create new alternatives for your parcels.
7. Verify where the alternative point and restart the roles on the host.
Feel free to keep us updated here.