Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how hdfs store file which has line with size more than hdfs block?

how hdfs store file which has line with size more than hdfs block?

New Contributor

Ex. consider file has only 1 line. File size is 500MB. how hdfs stores the file? how many blocks are used to store such file in hdfs?

3 REPLIES 3

Re: how hdfs store file which has line with size more than hdfs block?

Super Mentor

Re: how hdfs store file which has line with size more than hdfs block?

New Contributor

@Jay SenSharma

My question is more around on line size.

Consider, a hive table has two rows, each with size of 500MB (more than Normal hdfs Block size).

How hdfs stores file when row size is greater than block size?

Does hdfs stores partial row in one block and remaining on other block.?

Re: how hdfs store file which has line with size more than hdfs block?

Contributor

@pratik vagyani:

Yes, HDFS partial row in one block and remaining on other block in the case where each row contains data that is more than the block size. Refer to the below link for more details:-

https://www.quora.com/How-does-HDFS-split-files