Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Please see the Cloudera blog for information on the Cloudera Response to CVE-2021-4428

limit the resource for CDSW users

Explorer

Hi,

 

I'm trying to find a way to limit the resource a user can request.

It is easy to limit the cpu and ram a user can use in CDH by YARN dynamic resource pool.

But I don't know how to limit the docker instance a user can request in CDSW.

I have read all the official documents but it does not mention anything about it.

I tried in CDSW and find that user can open dockers as much as  he/she wants and make CDSW unavailability for anybody else.

So, is there some method to limit the resource a user can request inside CDSW cluster?

Thanks a lot.

1 ACCEPTED SOLUTION

Accepted Solutions

Rising Star

You can configure engine CPU and memory configurations in the Admin > Engines tab.  However CDSW does not currently have a quota system, akin to YARN resource pools.  This is a roadmap item we are actively working on.  If you have specific requirements, please let us know.

 

Tristan

View solution in original post

2 REPLIES 2

Rising Star

You can configure engine CPU and memory configurations in the Admin > Engines tab.  However CDSW does not currently have a quota system, akin to YARN resource pools.  This is a roadmap item we are actively working on.  If you have specific requirements, please let us know.

 

Tristan

View solution in original post

Explorer
Ok, got it, thanks