Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is there some API to determine parent-child relation between YARN applications?

Solved Go to solution

Is there some API to determine parent-child relation between YARN applications?

Contributor

Hi,

I am wondering if there is a general way how to determine what YARN applications were started by some application and vice-versa if some YARN application was started by some other.

My use case is Oozie and sqoop where Oozie runs some launchers that in turn start some MR jobs to do the actual ingest. It is possible to browse through the logs to get ID of spawned application, but keep thinking that there should be some better way how to do it. This kind of relation must be stored somewhere, since when the Oozie workflow is killed all child processes are killed as well almost immediately.

Thanks for any hints,

Regards,

Pavel

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Is there some API to determine parent-child relation between YARN applications?

Yarn does not do this. There is no relationship AFAIK. It is done by the oozie server. If oozie doesn't do it ( which can happen ) the jobs run on till they finish.

View solution in original post

1 REPLY 1
Highlighted

Re: Is there some API to determine parent-child relation between YARN applications?

Yarn does not do this. There is no relationship AFAIK. It is done by the oozie server. If oozie doesn't do it ( which can happen ) the jobs run on till they finish.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here