Created on 04-02-2018 08:41 AM - edited 09-16-2022 06:03 AM
Hi ,
do we have a coomand to check kudu table size. like hive and hbase table we can check size on hdfs .
do we have similar thing for kudu
Created 04-02-2018 10:09 AM
Created 06-25-2018 09:58 AM
Is there not a Kudu command which will allow for obtaining table size information? If not, then how does Cloudera Manager perform this? We would like to be able to replicate this behavior so that we can configure e-mail alerts to be sent whenever a table reaches a particular size.
Thanks,
Braz
Created 04-18-2019 03:36 PM
@Braz wrote:Is there not a Kudu command which will allow for obtaining table size information? If not, then how does Cloudera Manager perform this? We would like to be able to replicate this behavior so that we can configure e-mail alerts to be sent whenever a table reaches a particular size.
Thanks,
Braz
CM is scrapping and aggregating the /metrics pages from the tablet server instances for each tablet/table.
Have you reviewed CM triggers/alerts?[1] You might be able to configure email alerts with a similar trigger rule for table sizes.
Alternatively, you could implement what CM currently does by scraping each tablet server's /metrics page and aggregating the data together per tablet/table.
[1] https://www.cloudera.com/documentation/enterprise/latest/topics/cm_dg_triggers_usecases.html
Created 04-18-2019 11:24 AM
I just wanted to add to Todd's suggestion: also if you have CM, you can create a new chart with this query: "select total_kudu_on_disk_size_across_kudu_replicas where category=KUDU_TABLE", and it will plot all your table sizes, plus the graph detail will list current values for all entries.
Probably not easily scriptable, but at least a way to quickly copy all sizes in one go, looking like this:
7.2T impala::<tablename_redacted> (Kudu)
9.8T impala::<tablename_redacted> (Kudu)
6.5T impala::<tablename_redacted> (Kudu)
4.1G impala::<tablename_redacted> (Kudu)
21.5G impala::<tablename_redacted> (Kudu)
15.2G impala::<tablename_redacted> (Kudu)
6.1T impala::<tablename_redacted> (Kudu)
98G impala::<tablename_redacted> (Kudu)
23.2G impala::<tablename_redacted> (Kudu)
10G impala::<tablename_redacted> (Kudu)
9.1G impala::<tablename_redacted> (Kudu)
1.2T impala::<tablename_redacted> (Kudu)
7.5G impala::<tablename_redacted> (Kudu)
2.6T impala::<tablename_redacted> (Kudu)
35.8T impala::<tablename_redacted> (Kudu)