question Storage and compute analysis in Cloudera Data Analytics (CDA) Forum

Storage and compute analysis

phir1 — Tue, 02 Jan 2024 21:48:20 GMT

Hello,

let’s say a Datalake is used by several departments within a company.

What are recommended ways to measure Compute and Storage by department, for billing purposes?

Many thanks.

Re: Storage and compute analysis

cloude — Wed, 03 Jan 2024 13:39:35 GMT

@phir1 Generally I have seen customers chargeback on the usage of storage Quota and Resource allocation on the queue level. You can also use the above or chargeback based on node sponsorship.

Don't forget to mark it accepted if you are satisfied 🙂

Re: Storage and compute analysis

phir1 — Fri, 05 Jan 2024 12:16:38 GMT

Hi Cloude,
Thank your for your reply.
What do you mean by "usage of storage Quota and Resource allocation on the queue level"? What's the Queue Level?

Re: Storage and compute analysis

cloude — Sun, 07 Jan 2024 03:35:40 GMT

@phir1 , Create a queue for each dept and assign the requested resources. Now you know the dept is using how much resources.