Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

For Hive Users, is there anyway to restrict/define the usage of M/R slot ?

Solved Go to solution

For Hive Users, is there anyway to restrict/define the usage of M/R slot ?

Hi, I have hive server running with Remote Mysql DB. hive-server-0.10.0+198-1.cdh4.4.0.p0.15~squeeze-cdh4.4 I have group of users using HIVE and running their queries. I want something to control these users Slot usage (like want to regulate their Slot usage.) is there anyway to restrict/define the usage of M/R slot ? Kindly advice me how to deal with this requirement. Best Regards, bommuRaj
1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: For Hive Users, is there anyway to restrict/define the usage of M/R slot ?

Master Guru
The job scheduler would be the spot to look at.

One way would be to use user-named pools in FairScheduler.

You will need to define a FairScheduler <pool> configuration per user, that then control the maxMaps and maxReduces configuration for each of them, as defined at http://archive.cloudera.com/cdh4/cdh/4/mr1/fair_scheduler.html#Allocation+File+Format.

View solution in original post

2 REPLIES 2
Highlighted

Re: For Hive Users, is there anyway to restrict/define the usage of M/R slot ?

Master Guru
The job scheduler would be the spot to look at.

One way would be to use user-named pools in FairScheduler.

You will need to define a FairScheduler <pool> configuration per user, that then control the maxMaps and maxReduces configuration for each of them, as defined at http://archive.cloudera.com/cdh4/cdh/4/mr1/fair_scheduler.html#Allocation+File+Format.

View solution in original post

Highlighted

Re: For Hive Users, is there anyway to restrict/define the usage of M/R slot ?

Thank you Harsh !!!

Don't have an account?
Coming from Hortonworks? Activate your account here