Kudu leader master uses too much memory

[#1]

Hello!

I'm using kudu as my data store.

But kudu leader master uses too much memory(about 30GB), and other masters and tablet servers uses much less(about 2GB).

Leader master's memory usage

Follower master's memory usage

Kudu Master spec:

• 3 nodes
• 16GB physical memory per master
• 32GB swap memory per master

Kudu Tablet spec:

• 8 nodes
• 16GB physical memory per tablet server

Metrics says 35335258112 byte(35.34 GB) are used by generic_heap_size.

Does anyone knows about this?

[#2]

Hi Team, Leader master is the one who takes all front hit coming from client or connection so its obvious the consumption of Leader will be high

[#3]

 Hi Team,

The Kudu leader master maintains the entire metadata state in memory. This includes all table schemas, tablet locations, consensus state, and other cluster metadata.
If your cluster has a large number of tables, tablets, partitions, or complex schemas, the metadata size can grow substantially.
Tablet servers use less memory because they mainly hold tablet data and cache, but metadata is primarily on masters.Might be this is the reason we are seeing high memory usage on kudu leader master node.