kudu leader master memory leak

Hongh — Tue, 25 Oct 2022 08:59:27 GMT

Hello guys.

I'm trying to use kudu as my data store.

But my kudu leader master keep dead by OOM.

Follower masters and all tablet uses very few memory.

Leader master's memory usage

Follower master's memory usage

Tablet Server's memory usage

Kudu Master spec is:

3 masters
16GB physical memory per master
32GB swap memory per master

Kudu Tablet spec is:

8 tablet servers
16GB physical memory per tablet server

Metrics says generic_heap_size is 35335258112(35335 MB, 35.34 GB).

I tried to debug memory usage, but pprof don't catch all memories.

(pprof shows only 2063 MB)

Does anyone know reason?

Re: kudu leader master memory leak

Asfahan — Fri, 15 Nov 2024 10:17:39 GMT

1. Does it reduce the memory consumption once restart of this server
2. Leader master will have more consumption but in your case its look like a bug to me

What is the CDH/CDP version you are using

question kudu leader master memory leak in Support Questions

kudu leader master memory leak

Re: kudu leader master memory leak