question Re: Kudu leader master uses too much memory in Support Questions

Kudu leader master uses too much memory

Hongh — Mon, 31 Oct 2022 01:15:32 GMT

Hello!

I'm using kudu as my data store.

But kudu leader master uses too much memory(about 30GB), and other masters and tablet servers uses much less(about 2GB).

Leader master's memory usage

Follower master's memory usage

Kudu Master spec:

3 nodes
16GB physical memory per master
32GB swap memory per master

Kudu Tablet spec:

8 nodes
16GB physical memory per tablet server

Metrics says 35335258112 byte(35.34 GB) are used by generic_heap_size.

Does anyone knows about this?

Re: Kudu leader master uses too much memory

Asfahan — Fri, 15 Nov 2024 10:09:48 GMT

Hi Team, Leader master is the one who takes all front hit coming from client or connection so its obvious the consumption of Leader will be high

Re: Kudu leader master uses too much memory

skedare — Wed, 17 Sep 2025 12:11:05 GMT

Hi Team,

The Kudu leader master maintains the entire metadata state in memory. This includes all table schemas, tablet locations, consensus state, and other cluster metadata.
If your cluster has a large number of tables, tablets, partitions, or complex schemas, the metadata size can grow substantially.
Tablet servers use less memory because they mainly hold tablet data and cache, but metadata is primarily on masters.Might be this is the reason we are seeing high memory usage on kudu leader master node.