Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Disabling checksum in Haddop clients

Disabling checksum in Haddop clients

New Contributor

Hi,

 

My name is Sharon, I got a question about usage of cloudera with HDFS:

I want to use Cloudera for some computation, and set the HDFS clients using HDFS (computation nodes using HDFS) to not use checksum at all (disabling checksum, using NULL version).

I saw that it's possible from HDFS protocol perspective (by looking in the apache open source), i wonder if i can use cloudera for setting the clients to ask for checksum NULL.

By trying to look for documentation i only found an option for setting the checksum chunk size, not disabling checksum at all.

Is it possible to disable checksum for all clients using Cloudera? what is the default checksum computation (CRC32/ CRC32C/ other)?

 

Thanks in advance,

Sharon.

1 REPLY 1

Re: Disabling checksum in Haddop clients

Master Guru
Are you looking to disable checksum tests during read, or entirely bail on checksums even during writes?
Don't have an account?
Coming from Hortonworks? Activate your account here