Support Questions

Find answers, ask questions, and share your expertise

kudu leader master memory leak

avatar
New Contributor

Hello guys.

I'm trying to use kudu as my data store.

But my kudu leader master keep dead by OOM.

Follower masters and all tablet uses very few memory.

 

Leader master's memory usage

Hongh_3-1666687375372.png

 

Follower master's memory usage

Hongh_2-1666687359895.png

Tablet Server's memory usage

Hongh_0-1666688339661.png

 

 

Kudu Master spec is:

  • 3 masters
  • 16GB physical memory per master
  • 32GB swap memory per master

Kudu Tablet spec is:

  • 8 tablet servers
  • 16GB physical memory per tablet server

Metrics says generic_heap_size is 35335258112(35335 MB, 35.34 GB).

I tried to debug memory usage, but pprof don't catch all memories.

(pprof shows only 2063 MB)

Hongh_0-1666688202018.png

 

 

Does anyone know reason?

 

1 REPLY 1

avatar
Expert Contributor

1. Does it reduce the memory consumption once restart of this server
2. Leader master will have more consumption but in your case its look like a bug to me

What is the CDH/CDP version you are using