Hello All, We are using CDH 5.8 and want to setup a control on resuorce utilization ( CPU ,RAM) and Disk space utilization on cluster of different users.
We have setup Dynamic resource pools to setup job level restricition and now we want to set up disk utilization for indidual users . Like user A can use only use 10 GB under /u01/ABC.
We are using Sentry Service in CDH setup . We can configure disk space urilization at indidual/group of users uising Sentry Service ?
Or what we should do to achive this.
dynamic resource pool will take care of CPU & RAM.
You can try the below option for disk space utilization
Login to CM as Full admin -> Click on Cluster menu on top -> Reports -> Disk Usage(HDFS) -> Directory Usage (will appear only for admin) -> select one or more dir as needed (or) Navigate to child dir -> Action for Selected -> Manage Quota -> Disk Quota -> Limit disk space
Hello Saranvisa ,
Thanks a lot for you reply.
I will try this for set Quota on directories.
Will we are able to allocate Quota to users as well in this ? How to select users/groups and define size in GB on a perticuler directory ?
As per our requirment we want to restrict users to use only allowed GB on perticuler dirctory.
Like we want to allocate space to users on directory So they can not use more space on any directory.