Support Questions
Find answers, ask questions, and share your expertise

How deep does command "yarn application -list -appStates ALL" goes

Rising Star

Hi everyone,

 

I'm using command in subject to fetch all yarn applications and use grep on the output to filter out a specific application . I wanted to find out what is the limit of this command, as in how far in the history does it go to get these states. Is this limited by the job history server limit or does it return something below that like last 1000 jobs etc?

 

Regards

1 ACCEPTED SOLUTION

Contributor

Since the "list" commands gets the apps from the ResourceManager and doesn't set any explicit filters and limits (except those provided with it) on the request, technically it returns all the applications which are present with RM at the moment. That number is controlled by "yarn.resourcemanager.max-completed-applications" config. Hope that clarifies.

View solution in original post

1 REPLY 1

Contributor

Since the "list" commands gets the apps from the ResourceManager and doesn't set any explicit filters and limits (except those provided with it) on the request, technically it returns all the applications which are present with RM at the moment. That number is controlled by "yarn.resourcemanager.max-completed-applications" config. Hope that clarifies.

; ;