question how can i modify the yarn-site.xml and container-executor.cfg and will not be covered by cm in Support Questions

how can i modify the yarn-site.xml and container-executor.cfg and will not be covered by cm

little-jack — Thu, 03 Aug 2023 05:44:16 GMT

hello, everyone;
I am a freshman as a CDH manager user, My CDH version is CDH 6.0.1, my boss let me configure our CDH cluster to support "docker on yarn", but i found that feature not be supported in CDH 6.x manager, that means i have a only way to support that with configure that by customer configure
so I decide to edit yarn-site.xml and container-executor.cfg manually at the node of cluster，but I found that will be covered automatically by cm。

how can i modify the yarn-site.xml and container-executor.cfg and will not be covered by cm.

thx

Re: how can i modify the yarn-site.xml and container-executor.cfg and will not be covered by cm

VidyaSargur — Thu, 03 Aug 2023 09:08:49 GMT

@little-jack, Welcome to our community! To help you get the best possible answer, I have tagged our experts @Babasaheb who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

Re: how can i modify the yarn-site.xml and container-executor.cfg and will not be covered by cm

Babasaheb — Thu, 03 Aug 2023 11:54:53 GMT

Hello @little-jack ,

Thank you for contacting Cloudera Support.

Yes, "Docker on YARN" is supported in CDP. If you are trying it in CDH, then you can try adding required/custom settings in CM >> Yarn >> YARN Service Advanced Configuration Snippet (Safety Valve) for yarn-site.xml and restart yarn.

If it will not work then you continue making changes from yarn-site.xml and container-executor.cfg from SSH/node and set chattr for these files so that changes will not revert when you will restart yarn. But if you have to make any changes in CM >> yarn and even any in other services dependent on yarn then you should remove chattr >> make the changes >> restart yarn and tweak docker on yarn settings again.

But would suggest you to please upgrade CDH to CDP where all bugs are fixed and you will be able to use the latest features added in CDP 7.1.8.

If this information helped you, then it will be appreciated if you will take a moment to click on KUDOS 🙂

Thank you.

Re: how can i modify the yarn-site.xml and container-executor.cfg and will not be covered by cm

little-jack — Fri, 04 Aug 2023 01:50:53 GMT

thx，got it😃