Support Questions
Find answers, ask questions, and share your expertise

Hive view issue

Highlighted

Hive view issue

PFA for whole issue we are facing . hive-view-error-log.txt

using Ambari 2.4.1 and HDP2.5 .

FYI - Ambari server has started with root user.

we have configured below properties in Ambari.

hadoop.proxyuser.root.groups=*

hadoop.proxyuser.root.hosts=FQDN(ambari-serverhost)

Getting below error in Hive view .

Error :

Caused by: org.apache.hadoop.security.authorize.AuthorizationException: Unauthorized connection for super-user: root from IP xx.xx.xx.xx at sun.reflect.GeneratedConstructorAccessor3693.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.toIOException(WebHdfsFileSystem.java:509) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:487) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$200(WebHdfsFileSystem.java:113) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathOutputStreamRunner$1.close(WebHdfsFileSystem.java:936) at org.apache.ambari.view.utils.hdfs.HdfsUtil.putStringToFile(HdfsUtil.java:48) ... 101 more

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): Unauthorized connection for super-user: root from IP xx.xx.xx.xx at org.apache.hadoop.hdfs.web.JsonUtil.toRemoteException(JsonUtil.java:118) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:477) ... 104 more

7 REPLIES 7
Highlighted

Re: Hive view issue

Super Mentor

@srini

Try to set up a proxy user forrootin core-site.xml by clicking

HDFS > Configs > Custom core-site > Add Property. In the Add Property dialog box, you add the following keys and values:

hadoop.proxyuser.root.hosts=*

.

Or please make sure that the hostname contains the ambari FQDN (instead of IP Address)

hadoop.proxyuser.root.hosts=AMBARI_HOSTNAME_FQDN
Highlighted

Re: Hive view issue

We have added above 2 properties as you mentioned. still we are facing the same issue

Re: Hive view issue

Super Mentor

@srini

Instead of IP Address can you define the ambari hostname there. Looks like you have defined the IP Address.

hadoop.proxyuser.root.hosts=ambari_server_fqdn

.

Highlighted

Re: Hive view issue

I have mentioned FQDN only in Ambari .mentioned wrongle here , sorry for that .

Highlighted

Re: Hive view issue

Super Mentor

@srini

Are you able to open the following kind of URL from ambari server host or other hosts ?

http://xx.xx.xx.xx:50070/webhdfs/v1/tmp?op=GETFILESTATUS&user.name=admin

.

Highlighted

Re: Hive view issue

Super Mentor

Also please check if the hive is also set as proxyuser properly as :

hadoop.proxyuser.hive.hosts=*
hadoop.proxyuser.hive.groups=*

.

Ideally if you are running your ambari as "root" user then in order to fix the IP Address based unauthorized issue you should just deal with the "hadoop.proxyuser.root.hosts".

So can you check if setting this value to * is working? Do you have multiple IP Address associated with ambari server?

hadoop.proxyuser.root.hosts=*

.

Or if you are setting the ambari's correct FQDN there? I mean the output of following , followed by a "Restart Required Of Dependent" services.

hostname -f
Highlighted

Re: Hive view issue

@Jay SenSharma

I am able to acess above link .

Result of the above URL :

{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":8,"fileId":16386,"group":"hdfs","length":0,"modificationTime":1480691521527,"owner":"hdfs","pathSuffix":"","permission":"777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}


-----------------------------------

I have mentioned right value to right FQDN value to hadoop.proxyuser.root.hosts .
Still Having the issue