- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Cloudera 5.10 - cloudera_scm_agent seems to be deleting/uninstalling parcels/packages every minute
Created on ‎12-11-2020 10:53 AM - edited ‎09-16-2022 07:39 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Need Help here!.
Keep getting follow messages in cloudera-scm-agent log and noticed it deletes everything from
/etc/hadoop/ and puts back the content every minute -
This is causing some Mapreduce tasks to fail with File not found errors.
Created ‎01-09-2021 07:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Anks2411 This could be a bug since it's an older CM version but looking at the logs this seems issue with alternatives.
Can you try these steps and let me know if this improves the behaviour.
1. Stop all roles on the host.
2. Stop the agent.
3. Ensure that the agent and supervisord are fully stopped.
4. Verify the output of the follow command and ensure that it only captures information related to cloudera.
\ls -l /etc/alternatives/ | grep "\/opt\/cloudera"
5. Run the following shell script to cleanup and remove all alternatives related to cloudera parcels.
$ \ls -l /etc/alternatives/ | grep "\/opt\/cloudera" | awk {'print $9'} | \
while read m; do if [[ -e /var/lib/alternatives/${m} ]] ;then echo "Removing ${m}"; \
rm -fv /var/lib/alternatives/${m} ; fi; rm -fv /etc/alternatives/${m}; done
6. Start the agent and review the log data in /var/log/cloudera-scm-agent/cloudera-scm-agent.log. You should see the agent attempt to create new alternatives for your parcels.
7. Verify where the alternative point and restart the roles on the host.
Feel free to keep us updated here.
Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
