question Re: Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes? in Support Questions

Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

NamrataPawale — Fri, 11 Jan 2019 22:36:32 GMT

I have a mapreduce program that communicates with a process on localhost machine. When running this job using yarn docker containers, the job fails because the container fails to communicate with the process. I tried running the same job without launching docker container using yarn but using docker run and specifying --ipc="host" and it worked. Is it possible to configure yarn to run docker containers with "--ipc" option?

Re: Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

billie — Fri, 11 Jan 2019 23:06:47 GMT

The --ipc flag is not configurable through YARN at this time. There is a ticket open for adding this feature, YARN-8447. No one is currently working on this, so it could be helpful for you to add a comment to the ticket describing your use case.