Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kudu tablet servers - Resident Memory

Highlighted

Kudu tablet servers - Resident Memory

Explorer

We are creating kudu tables using Impala & kudu tablet server hard memory limit is 8GB.

 

After restarting kudu, each tablet server is only using 1.2GB memory

 

By using our application, we are reaching 7.2GB of memory and after some time when all the queries are done it is coming down to 3.6GB.

Even in the ideal state also it is still 3.6GB on all the tablet servers.

 

Can we bring down the resident memory further down?

kudu_memory_Max.pngMax memorykudu_memory_Min.pngminimum memory

 

 

1 REPLY 1

Re: Kudu tablet servers - Resident Memory

Master Collaborator
You can check the Kudu tablet servers UI to verify what consumes the memory. I think one of the reason could be that you have too many tablets across the cluster (i.e. it requires too many metadata). Or one other root cause can be when you have a table where you constantly insert small amount of data, always appending, this can cause small disk replicas. The solution is to re-create the whole table, this will "compact" the replicas and thus it will consume less memory.