Support Questions
Find answers, ask questions, and share your expertise

What is the best policy to divide a hadoop cluster in a multi-tenant environment.

Highlighted

What is the best policy to divide a hadoop cluster in a multi-tenant environment.

I manage a multi-tenant Hadoop cluster used by various teams. Capacity scheduler is used for Yarn Scheduling. We now want to create a charging model so that we can charge our clients for using the cluster. What are the best practices for creating such a model and what parameters shall be considered to charge our clients for using the cluster services?

We are running HDP 2.3.2.

1 REPLY 1
Highlighted

Re: What is the best policy to divide a hadoop cluster in a multi-tenant environment.

Super Guru
@Shashang Sheth

While there are chargeback features planned for Ambari, I don't believe there is one out there yet. If you haven't please take a look at the following link. If you are open to looking outside of open source environment, then pepperdata provides chargeback capabilities for Hadoop clusters.

http://www.slideshare.net/StampedeCon/apache-hadoop-yarn-multitenancy-capacity-scheduler-preemption-...

http://pepperdata.com/2015/09/introducing-comprehensive-chargeback-reporting-for-hadoop/