question Re: Queues configured for YARN dynamic resource pool or not? in Support Questions

Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Fri, 16 Sep 2022 12:03:33 GMT

Hello All,

I am new to cloudera. I am using cloudera manager console 5.4.

Under dynamic resource pool , I find two tabs status and configuration.

In status, I see various queues under resource pool usage. However I can't edit info over there.

And in configuration, I find no queues configured , only default queue .

Can you please tell me whether queues are configured or not?

Thanks,

Priya

Re: Queues configured for YARN dynamic resource pool or not?

csguna — Tue, 08 Aug 2017 06:18:08 GMT

If you follow the belows the screen you should be able to configure or change the queue

screen 1screen 2

screen 3

to double check you can go to YARN- configuration -> type queu in the search bar

refer the screen ( YARN Screen)

YARN Screen

Let me know if that helps

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Tue, 08 Aug 2017 06:30:22 GMT

Hi,

I am unable to view attachments you posted in your reply.

Can you please resend the attachments?

Thanks,

Priya

Re: Queues configured for YARN dynamic resource pool or not?

csguna — Tue, 08 Aug 2017 07:19:02 GMT

Sure thing .

Screen 1Screen 2Screen 3Screen - Yarn Configuration

Let me know if you still have trouble viewing it

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Tue, 08 Aug 2017 07:21:26 GMT

Nope. Still I am unable to see it..

Re: Queues configured for YARN dynamic resource pool or not?

csguna — Tue, 08 Aug 2017 12:39:18 GMT

TO VIEW THE POOL CONFIGURATION

YARN -> CONFIGURATION -> SEARCH screen

YARN - screen - double check

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Tue, 08 Aug 2017 13:02:04 GMT

Can you please send png image. I am still not able to see it.. 😞

Re: Queues configured for YARN dynamic resource pool or not?

cjervis — Tue, 08 Aug 2017 13:39:09 GMT

Sorry about this. The images were stuck in moderation but should be showing now.

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Tue, 08 Aug 2017 13:58:21 GMT

Yeah. Now I am able to see the images. Thanks cjervis and csguna for all the help

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Tue, 08 Aug 2017 14:08:01 GMT

Do we need to restart yarn after configuration changes or not required?

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Wed, 09 Aug 2017 04:57:18 GMT

Hi,

I configured queues in dynamic resource pool, but when I checked in Yarn config, queues were not reflected there. Yarn restart required to get reflected those values or not?

Re: Queues configured for YARN dynamic resource pool or not?

csguna — Wed, 09 Aug 2017 06:22:11 GMT

Yes Yarn restart is required , if you are using Cloudera manager then a Stale restart is required

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Wed, 09 Aug 2017 06:29:12 GMT

I have configured queues through dynamic resource pool in cloudera manager only. I don't see such option anywhere though. Also, when I checked fair-scheduler.xml file on resourcemanager server at /var/run/cloudera-scm-agent/process/2907-yarn-RESOURCEMANAGER location, I am able to see configured queues. Whereas I don't see names in cloudera manager under Yarn config.
Please suggest.

Thanks,
Priya

Re: Queues configured for YARN dynamic resource pool or not?

cdhhadoop — Wed, 09 Aug 2017 11:13:22 GMT

When I restarted resourmanager, it worked and was showing correct details everywhere.

Thanks,
Priya

Re: Queues configured for YARN dynamic resource pool or not?

Siddesh2104 — Fri, 11 Aug 2017 16:02:41 GMT

Hi,

I have dynamic resource pools configured. Do I need to enable Cgroups as well? is it any helpful?