Skip to main content
divakarreddy_a
divakarreddy_a
Gold ⭐️
August 6, 2016

Performance Comparison b/w ORC SNAPPY and ZLib in hive/ORC files.

  • October 5, 2026 at 9:37 AM
  • 2 replies
  • 9875 views
  • Translate All

Test Conducted on:

1) HDP2.3.4

2) Data Size : 1.4 GB

2) Cluster is ideal and not running any other jobs.

Conclusion:

Observed that Zlib is doing more compression than SNAPPY but SNAPPY jobs are completing quicker than ZLib.

Results are here:

Execution Time in Sec:

6293-snappy-zlib-per.png

Disk Usage Comparison:

6295-diskusage.png

    2 replies

    thejas
    Gold ⭐️
    thejas
    Gold ⭐️
    August 7, 2016

    Thanks for sharing. What query is this ? Is this performance of reads or writes ?

    Translate
    divakarreddy_a
    divakarreddy_aAuthor
    Gold ⭐️
    August 10, 2016
    @thejas

    I tested with insert script, basically writes.

    Translate
    Terms & ConditionsAccessibility statement