https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172729#M37552 <P><A rel="user" href="https://community.cloudera.com/users/12437/balavigneshnagamuthuvenkatesan.html" nodeid="12437">@Bala Vignesh N V</A></P><P>Yes, the difference in count is expected. ORC converts the table data into groups of rows called stripes along with auxiliary information in a file footer, default size of stripe is 250 MB. Hence, there will be difference in wc -l on orc file compared to actual numbers of rows in the table.</P> Thu, 11 Aug 2016 17:06:39 GMT ssubhas 2016-08-11T17:06:39Z https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172728#M37551 <P>Value differs when I check the count(*) using hive query and when I check the no of lines in the corresponding file. Seelect count(*) from table gives 100 as output where as wc -l of the corresponding file gives 30. My table is in ORC format. Is it how orc behaves?</P> Thu, 11 Aug 2016 17:02:44 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172728#M37551 balavignesh_nag 2016-08-11T17:02:44Z https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172729#M37552 <P><A rel="user" href="https://community.cloudera.com/users/12437/balavigneshnagamuthuvenkatesan.html" nodeid="12437">@Bala Vignesh N V</A></P><P>Yes, the difference in count is expected. ORC converts the table data into groups of rows called stripes along with auxiliary information in a file footer, default size of stripe is 250 MB. Hence, there will be difference in wc -l on orc file compared to actual numbers of rows in the table.</P> Thu, 11 Aug 2016 17:06:39 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172729#M37552 ssubhas 2016-08-11T17:06:39Z https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172730#M37553 <P>Thanks <A href="https://community.hortonworks.com/users/5019/ssubhas.html">Sindhu</A>. What happens when we store it as TEXTFILE. The count should remain the same right?</P> Thu, 11 Aug 2016 17:15:27 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172730#M37553 balavignesh_nag 2016-08-11T17:15:27Z https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172731#M37554 <P>Yes, it would be same.</P> Thu, 11 Aug 2016 17:44:44 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/count-in-hive-and-the-wc-of-hadoop-file-is-different/m-p/172731#M37554 ssubhas 2016-08-11T17:44:44Z