Reply
Explorer
Posts: 28
Registered: ‎08-29-2017

Apply snappy compression is it reducing the cpu and memory by any % ?

HI,

 

I used snappy compresson in Hbase

 

storage got compressed

 

 

does it 

Is this reducing the cpu and memory by any % ?

Posts: 1,565
Kudos: 287
Solutions: 239
Registered: ‎07-31-2013

Re: Apply snappy compression is it reducing the cpu and memory by any �

The cache of data held in memory (RAM) of RSs are uncompressed. So no,
compressing data will not bring savings in use of RAM or heap for cache
storage.

Compressing anything follows the space time trade-off, so you will see
marginally higher CPU usage depending on the workload. Snappy is designed
to compress quick vs. saving more, so the CPU impact will be lesser
compared to (for ex.) bzip2. It may even be insignificant, depending on
your workload.
Backline Customer Operations Engineer
Highlighted
Explorer
Posts: 28
Registered: ‎08-29-2017

Re: Apply snappy compression is it reducing the cpu and memory by any �

Then Can you suggest any techniques for reducing cpu or memory.

 

 

Use case is millions of records in Hbase. Stored in Hbase. have a external table in hive pointing to Hbase. Need to write Impala queries for retrival. For processing data in Hbase i am using hive queries. 

 

Any other suggestions or techniques pls tell.

Announcements