11-08-2018 01:13 AM
I'm new here, and I'm excited about the solutions of Cloudera, but I have some doubts when considering the use of these solutions in a project that we are facing.
The main one would be, what problems could have to increase the storage size in the tablet servers beyond the recommended 8 TB?
11-08-2018 02:11 PM
It is possible to store more than the recommendations amount of data on a tablet server. We have such recommendations because that is what have been well tested. The same for storing more than 2000 tablets on a tablet server. Some performance degradation could be 1) the server restart time gets longer, as on disk data grows. 2) as tablets accrue more data blocks, their superblocks become larger, raising the minimum amount of I/O for any operation that rewrites a superblock (such as a flush or compaction). 3) the tablet copy protocol used in rereplication tries to copy the entire superblock in one RPC message; if the superblock is too large, it'll run up against the default 50 MB RPC transfer size (see src/kudu/rpc/transfer.cc).
11-09-2018 12:47 PM