Support Questions

Find answers, ask questions, and share your expertise

how hdfs store file which has line with size more than hdfs block?

Ex. consider file has only 1 line. File size is 500MB. how hdfs stores the file? how many blocks are used to store such file in hdfs?

3 REPLIES 3

Super Mentor

@Jay SenSharma

My question is more around on line size.

Consider, a hive table has two rows, each with size of 500MB (more than Normal hdfs Block size).

How hdfs stores file when row size is greater than block size?

Does hdfs stores partial row in one block and remaining on other block.?

Contributor

@pratik vagyani:

Yes, HDFS partial row in one block and remaining on other block in the case where each row contains data that is more than the block size. Refer to the below link for more details:-

https://www.quora.com/How-does-HDFS-split-files