Performance Comparison b/w ORC SNAPPY and ZLib in hive/ORC files.

[#1]

Test Conducted on:

1) HDP2.3.4

2) Data Size : 1.4 GB

2) Cluster is ideal and not running any other jobs.

Conclusion:

Observed that Zlib is doing more compression than SNAPPY but SNAPPY jobs are completing quicker than ZLib.

Results are here:

Execution Time in Sec:

Disk Usage Comparison:

[#2]

Thanks for sharing. What query is this ? Is this performance of reads or writes ?

[#3]

@thejas

I tested with insert script, basically writes.