Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

Solved Go to solution

Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

New Contributor

I have a mapreduce program that communicates with a process on localhost machine. When running this job using yarn docker containers, the job fails because the container fails to communicate with the process. I tried running the same job without launching docker container using yarn but using docker run and specifying --ipc="host" and it worked. Is it possible to configure yarn to run docker containers with "--ipc" option?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

Rising Star

The --ipc flag is not configurable through YARN at this time. There is a ticket open for adding this feature, YARN-8447. No one is currently working on this, so it could be helpful for you to add a comment to the ticket describing your use case.

1 REPLY 1

Re: Is it possible to execute a job in yarn docker container with docker run's "--ipc" cli option configured so that the container can communicate with host processes?

Rising Star

The --ipc flag is not configurable through YARN at this time. There is a ticket open for adding this feature, YARN-8447. No one is currently working on this, so it could be helpful for you to add a comment to the ticket describing your use case.