Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apply snappy compression is it reducing the cpu and memory by any % ?

Apply snappy compression is it reducing the cpu and memory by any % ?

HI,

 

I used snappy compresson in Hbase

 

storage got compressed

 

 

does it 

Is this reducing the cpu and memory by any % ?

2 REPLIES 2
Highlighted

Re: Apply snappy compression is it reducing the cpu and memory by any �

Master Guru
The cache of data held in memory (RAM) of RSs are uncompressed. So no,
compressing data will not bring savings in use of RAM or heap for cache
storage.

Compressing anything follows the space time trade-off, so you will see
marginally higher CPU usage depending on the workload. Snappy is designed
to compress quick vs. saving more, so the CPU impact will be lesser
compared to (for ex.) bzip2. It may even be insignificant, depending on
your workload.

Re: Apply snappy compression is it reducing the cpu and memory by any �

Then Can you suggest any techniques for reducing cpu or memory.

 

 

Use case is millions of records in Hbase. Stored in Hbase. have a external table in hive pointing to Hbase. Need to write Impala queries for retrival. For processing data in Hbase i am using hive queries. 

 

Any other suggestions or techniques pls tell.

Don't have an account?
Coming from Hortonworks? Activate your account here