Support Questions

Find answers, ask questions, and share your expertise

how to reference an HA hadoop cluster using the nameserviceId?

New Contributor

I have an HA hadoop cluster with 2 namenodes and the nameserviceId as "nameservice1" . When I am trying to make connection to this cluster using url like below it gives me error :


curl -i "http://nameservice1/webhdfs/v1/user/hdfs/?blocksize=67108864&replication=3&permission=744&dfs.nameservices=nameservice1&dfs.ha.namenodes.nameservice1=master1,master2&"


Ho can one call an HA hadoop cluster using webhdfs?


Super Mentor



WebHDFS does not natively support Namenode HA (means you can not use "namesrvice" name in the URL) but you can use Knox to provide the functionality.




SO either you can configure components like Knox in front of nameNodes  Or you will have to use the webhdfs with individual NameNode address:port in the webhdfs URL.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.