kudu - tablet_id with different volume between tablet servers

Question

hello cloudera community,

we identified that there is tablet_id with different volume among the cluster's tablet servers

there is tablet_id with 700MB on one tablet server and the same tablet_id with 190MB on another tablet server

how can we equalize this volumetry between tablet_id on all tablet servers

we believe that with this different volumetry between the tablet_id, some hosts are using a lot of memory, practically 90% of memory of what was defined.

1 - we are using cloudera express 5.16.x
2 - a rebalance has already been performed on kudu recently

Asfahan · Answer

Hi,

kudu balancer balance tablet per TS but not the size of tablet,

1) what replication factor you have provided for kudu

2) please run the kudu cluster ksck master_address_fqdn <tablet_id>. << it will show you all the replica of this tablet and cross- check the size of tablet in all 3TS

My assumption is this tablet is new and kudu will be downloading the blocks on the same time thats why the replica is showing differ size but its an assumption, you need to trace the same via kudu TS logs which used to be under /var/log/kudu

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.