when do you not use orc tables?

pmj — Fri, 16 Sep 2022 12:49:58 GMT

Hi all,

I have some large tables in our hadoop cluster which are in text format, i would like to change all to orc ... is there something i need to worry about if all tables are orc? in what circumstances you dont use orc?

Thanks.

Re: when do you not use orc tables?

SQLShaw — Wed, 07 Feb 2018 02:26:30 GMT

Hi @PJ, the honest truth is there is no good reason not to use ORC format. You can use another format like Parquet but it won't provide ACID, LLAP cache, or the same level of performance. I would say the decision is similar to not using indexes in a relational system or not running statistics. ORC is simply best practice for high performance data warehousing in Hive.

Keep in mind that LLAP will allow you to cache raw text files. This may be an option if you have some strict SLA preventing you from incurring the conversion delay of the text file to ORC.

question Re: when do you not use orc tables? in Archives of Support Questions (Read Only)

when do you not use orc tables?

Re: when do you not use orc tables?