Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Is there some API to determine parent-child relation between YARN applications?

avatar
Rising Star

Hi,

I am wondering if there is a general way how to determine what YARN applications were started by some application and vice-versa if some YARN application was started by some other.

My use case is Oozie and sqoop where Oozie runs some launchers that in turn start some MR jobs to do the actual ingest. It is possible to browse through the logs to get ID of spawned application, but keep thinking that there should be some better way how to do it. This kind of relation must be stored somewhere, since when the Oozie workflow is killed all child processes are killed as well almost immediately.

Thanks for any hints,

Regards,

Pavel

1 ACCEPTED SOLUTION

avatar
Master Guru

Yarn does not do this. There is no relationship AFAIK. It is done by the oozie server. If oozie doesn't do it ( which can happen ) the jobs run on till they finish.

View solution in original post

1 REPLY 1

avatar
Master Guru

Yarn does not do this. There is no relationship AFAIK. It is done by the oozie server. If oozie doesn't do it ( which can happen ) the jobs run on till they finish.