Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

[#1]

I have a mapreduce program that communicates with a process on localhost machine. When running this job using yarn docker containers, the job fails because the container fails to communicate with the process. I tried running the same job without launching docker container using yarn but using docker run and specifying --ipc="host" and it worked. Is it possible to configure yarn to run docker containers with "--ipc" option?

[#2 · Accepted solution]

The --ipc flag is not configurable through YARN at this time. There is a ticket open for adding this feature, YARN-8447. No one is currently working on this, so it could be helpful for you to add a comment to the ticket describing your use case.