question Re: Since ACID Transactions cannot be done through Parquet format in HIVE , what are the restrictions Parquet have that ORC doesn't? in Archives of Support Questions (Read Only)

Since ACID Transactions cannot be done through Parquet format in HIVE , what are the restrictions Parquet have that ORC doesn't?

kpurushothaman7 — Thu, 14 Sep 2017 13:24:35 GMT

Fill in the details...

Re: Since ACID Transactions cannot be done through Parquet format in HIVE , what are the restrictions Parquet have that ORC doesn't?

balavignesh_nag — Fri, 15 Sep 2017 13:50:33 GMT

Check this blog. You have a detailed comparison between ORC and Parquet.

Other than that there are very in terms of use case. But in the future most I believe most of the improvements are being developed based on ORC i believe.

1. Many of the performance improvements provided in the Stinger initiative are dependent on features of the ORC format including block level index for each column. This leads to potentially more efficient I/O allowing Hive to skip reading entire blocks of data if it determines predicate values are not present there. Also the Cost Based Optimizer has the ability to consider column level metadata present in ORC files in order to generate the most efficient graph.

2. ACID transactions are only possible when using ORC as the file format

Re: Since ACID Transactions cannot be done through Parquet format in HIVE , what are the restrictions Parquet have that ORC doesn't?

balavignesh_nag — Fri, 15 Sep 2017 13:51:07 GMT

Hope it helps! If so then please accept it as best answer!

Re: Since ACID Transactions cannot be done through Parquet format in HIVE , what are the restrictions Parquet have that ORC doesn't?

kpurushothaman7 — Fri, 15 Sep 2017 16:28:44 GMT

Thanks....