Support Questions
Find answers, ask questions, and share your expertise

How to connect Hortonworks HDP 2.6 to Azure Storage account?

New Contributor

I have setup the Hadoop cluster using Hortonworks Sandbox HDP 2.6 on Virtual Box. Now I want to setup the connection of my cluster with Microsoft Azure Storage Explorer. I have followed the installation instruction from here: Link And I have edited the Custom core-site.xml from Ambari UI (as admin) to add the property:

16197-ima.png

After that I have restarted all the services.

To test my connection, I ran the following command which will create a directory(testDir) to Azure storage

hadoop fs -mkdir wasb://yourcontainer@youraccount.blob.core.windows.net/testDir

I got the following error:

16198-img2.png

Am I skipping any step in setting up the connection? Any help is appreciated!

3 REPLIES 3

@Juhi Garg

It is not clear for me based on your description if you have successfully set up a storage account and created a container before trying to use WASB (which is a prerequisite).

Have you followed the steps detailed here?

There is a very good walkthrough here!

And finally, there is a good technical overview here.

Hope this helps!

@Juhi Garg

I'm not sure if the connector is supported in HDP 2.6 Sandbox. I know we support it for HDP 2.6.1.

Maybe @Mingliang Liu can help.

@Juhi Garg

If you find my answer satisfactory, would you please consider accepting it? Thanks!