Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Azure Data Lake Store (ADLS) vs Blob Storage I/O Throughput with distcp

Azure Data Lake Store (ADLS) vs Blob Storage I/O Throughput with distcp

New Contributor

I have a 12 nodes cluster of D12v2 (4 cores, 28GB, 200GB) images. We're copying about 100GB from the cluster's local HDFS to ADLS or WASB. I believe Blob Storage is being capped at 1000 IOPS per account, I was wondering what to expect copying to ADLS with a conservative number of mappers (36-48).

Thanks!

1 REPLY 1

Re: Azure Data Lake Store (ADLS) vs Blob Storage I/O Throughput with distcp

New Contributor

Did you figure out the difference? I am also interested in the difference between ADLS and Blob storage in terms of performance.

Thanks!

Don't have an account?
Coming from Hortonworks? Activate your account here