I have two clusters which are independent and need to do distcp.
ClusterA (has webhdfs enabled)
ClusterB(which needs to fetch data)
on ClusterB, if I can access data using Hadoop cli,
Error: E0803 : E0803: IO error, Unauthorized connection for super-user: oozie from IP 220.127.116.11
does clusterA, requires my oozie hostname/ip to be present in core-site.xml?
or is there any other better way when webhdfs is enabled on clusterA, to do distcp to clusterB?
The error indicates that you might have not set the "" property properly in your HDFS configs.
Unauthorized connection for super-user: oozie from IP 18.104.22.168
You can check if you have the following entries there or not? In Ambari Web, browse to Services > HDFS > Configs.
Under the Advanced tab, navigate to the Custom core-site section.