Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Azure Data Lake and HDP 2.5

Azure Data Lake and HDP 2.5

Contributor

Can I attach Azure Data Lake Store to HDP 2.5 as an underlining HDFS storage?

2 REPLIES 2
Highlighted

Re: Azure Data Lake and HDP 2.5

Mentor

@Dagmawi Mengistu currently the only way you can leverage ADLS as underlying storage is to use Azure HDInsights 3.5 https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-hdinsight-hadoop-use-portal

If you have a choice to use WASB instead, then you can also use Cloudbreak service, by default it will provision with WASB instead of HDFS http://sequenceiq.com/cloudbreak-docs/latest/azure/

Highlighted

Re: Azure Data Lake and HDP 2.5

@Dagmawi Mengistu the next release of Cloudbreak supports the usage of ADLS as per the documentation, as it has been backported to HDP 2.5.0.1, so you can launch HDP clusters with ADLS support. It is coming in the next weeks.

In the current version of Cloudbreak, you can use WASB either besides local HDFS or as a default file system as well.

Don't have an account?
Coming from Hortonworks? Activate your account here