Member since
04-24-2016
2
Posts
0
Kudos Received
0
Solutions
04-24-2016
09:57 AM
1 Kudo
The HDFS client reads your input and sends packets of data (64k-128k chunks at a time) which are sent along with their checksums over the network, and the DNs involved in the write verify these continually as they receive them, before writing them to disk. This way you wouldn't suffer from network corruptions, and what's written onto the HDFS would match precisely what the client intended to send.
... View more