Support Questions

Find answers, ask questions, and share your expertise

Azure Data Lake and HDP 2.5

Contributor

Can I attach Azure Data Lake Store to HDP 2.5 as an underlining HDFS storage?

2 REPLIES 2

Mentor

@Dagmawi Mengistu currently the only way you can leverage ADLS as underlying storage is to use Azure HDInsights 3.5 https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-hdinsight-hadoop-use-portal

If you have a choice to use WASB instead, then you can also use Cloudbreak service, by default it will provision with WASB instead of HDFS http://sequenceiq.com/cloudbreak-docs/latest/azure/

@Dagmawi Mengistu the next release of Cloudbreak supports the usage of ADLS as per the documentation, as it has been backported to HDP 2.5.0.1, so you can launch HDP clusters with ADLS support. It is coming in the next weeks.

In the current version of Cloudbreak, you can use WASB either besides local HDFS or as a default file system as well.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.