For Hive Users, is there anyway to restrict/define the usage of M/R slot ?

[#1]

Hi, I have hive server running with Remote Mysql DB. hive-server-0.10.0+198-1.cdh4.4.0.p0.15~squeeze-cdh4.4 I have group of users using HIVE and running their queries. I want something to control these users Slot usage (like want to regulate their Slot usage.) is there anyway to restrict/define the usage of M/R slot ? Kindly advice me how to deal with this requirement. Best Regards, bommuRaj

[#2 · Accepted solution]

The job scheduler would be the spot to look at.

One way would be to use user-named pools in FairScheduler.

You will need to define a FairScheduler <pool> configuration per user, that then control the maxMaps and maxReduces configuration for each of them, as defined at http://archive.cloudera.com/cdh4/cdh/4/mr1/fair_scheduler.html#Allocation+File+Format.

[#3]

Thank you Harsh !!!