question Can columnar format occupy more space than row format in hive compression? in Archives of Support Questions (Read Only)

Can columnar format occupy more space than row format in hive compression?

Hadoopy — Fri, 16 Feb 2018 14:36:27 GMT

Even after columnar compression techniques like parquet my files are turning out to be bigger than sequence files. I wanted to know that is columnar compression a sure shot way to compression or is there some kind of data which fails here.

Re: Can columnar format occupy more space than row format in hive compression?

kgautam — Mon, 19 Feb 2018 19:42:31 GMT

Yess its possible only and only if there are no repetition in a column.
In this case one will end up with the file and meta info of the columnar file format.