Created 03-08-2017 11:25 AM
PFA for whole issue we are facing . hive-view-error-log.txt
using Ambari 2.4.1 and HDP2.5 .
FYI - Ambari server has started with root user.
we have configured below properties in Ambari.
hadoop.proxyuser.root.groups=*
hadoop.proxyuser.root.hosts=FQDN(ambari-serverhost)
Getting below error in Hive view .
Error :
Caused by: org.apache.hadoop.security.authorize.AuthorizationException: Unauthorized connection for super-user: root from IP xx.xx.xx.xx at sun.reflect.GeneratedConstructorAccessor3693.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.toIOException(WebHdfsFileSystem.java:509) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:487) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$200(WebHdfsFileSystem.java:113) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathOutputStreamRunner$1.close(WebHdfsFileSystem.java:936) at org.apache.ambari.view.utils.hdfs.HdfsUtil.putStringToFile(HdfsUtil.java:48) ... 101 more
Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): Unauthorized connection for super-user: root from IP xx.xx.xx.xx at org.apache.hadoop.hdfs.web.JsonUtil.toRemoteException(JsonUtil.java:118) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:477) ... 104 more
Created 03-08-2017 11:31 AM
Try to set up a proxy user forroot
in core-site.xml by clicking
HDFS > Configs > Custom core-site > Add Property. In the Add Property dialog box, you add the following keys and values:
hadoop.proxyuser.root.hosts=*
.
Or please make sure that the hostname contains the ambari FQDN (instead of IP Address)
hadoop.proxyuser.root.hosts=AMBARI_HOSTNAME_FQDN
Created 03-08-2017 11:39 AM
We have added above 2 properties as you mentioned. still we are facing the same issue
Created 03-08-2017 11:41 AM
Instead of IP Address can you define the ambari hostname there. Looks like you have defined the IP Address.
hadoop.proxyuser.root.hosts=ambari_server_fqdn
.
Created 03-08-2017 11:45 AM
I have mentioned FQDN only in Ambari .mentioned wrongle here , sorry for that .
Created 03-08-2017 11:55 AM
Are you able to open the following kind of URL from ambari server host or other hosts ?
http://xx.xx.xx.xx:50070/webhdfs/v1/tmp?op=GETFILESTATUS&user.name=admin
.
Created 03-08-2017 12:23 PM
Also please check if the hive is also set as proxyuser properly as :
hadoop.proxyuser.hive.hosts=* hadoop.proxyuser.hive.groups=*
.
Ideally if you are running your ambari as "root" user then in order to fix the IP Address based unauthorized issue you should just deal with the "hadoop.proxyuser.root.hosts".
So can you check if setting this value to * is working? Do you have multiple IP Address associated with ambari server?
hadoop.proxyuser.root.hosts=*
.
Or if you are setting the ambari's correct FQDN there? I mean the output of following , followed by a "Restart Required Of Dependent" services.
hostname -f
Created 03-08-2017 12:42 PM
I am able to acess above link .
Result of the above URL :
{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":8,"fileId":16386,"group":"hdfs","length":0,"modificationTime":1480691521527,"owner":"hdfs","pathSuffix":"","permission":"777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}} ----------------------------------- I have mentioned right value to right FQDN value to hadoop.proxyuser.root.hosts . Still Having the issue