Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

deploying oozie and hive with namenode ha via ambari blueprint

avatar
Explorer

on a cluster deployed via Ambari blueprint with namenode ha, hbase is able to resolve the dfs.nameservices and finds the right namenode , where us hive and oozie fails with the following error:

HDP VERSION: 2.4.2

Error: java.net.UnknownHostException: HDP1

Stack trace for the error was (for debug purposes):
--------------------------------------
java.lang.IllegalArgumentException: java.net.UnknownHostException: HDP1
    at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:411)
    at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:311)
    at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:678)
    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
    at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:150)
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653)
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
    at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
    at org.apache.oozie.service.HadoopAccessorService$4.run(HadoopAccessorService.java:513)
    at org.apache.oozie.service.HadoopAccessorService$4.run(HadoopAccessorService.java:511)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)<br>

Appreciate any suggestions, help

1 ACCEPTED SOLUTION

avatar
Explorer

soln: the solution is to install HDFS_CLIENT on the hive node, that way core-site.xml will be present and hence hive can use the dfs.nameservice config property

View solution in original post

1 REPLY 1

avatar
Explorer

soln: the solution is to install HDFS_CLIENT on the hive node, that way core-site.xml will be present and hence hive can use the dfs.nameservice config property