question Re: How to add another HiveServer for current metastore ? in Archives of Support Questions (Read Only)

How to add another HiveServer for current metastore ?

Adija1 — Tue, 01 Nov 2016 14:24:26 GMT

Hello

I have a cluster (HDP 2.3.2) with one edge node serving as Hive Server (running hiveserver2). This server is used for Hive ETL processes and also for end users that query the hive databases. Because this server is very busy i want to add another edge server that will be dedicated for the ETL processes, thus ending up with one edge node for ETL processes (that insert data to Hive tables), and a different edge node that serves end users for querying the same hive tables. I've added the new host to the cluster, ran the add HiveServer2 wizard. The Amabri shows everything is up and running. When i login to the new edge node, run "beeline" and login to hive but i can't see the tables in my old hive metastore. It is as if these are two completely separate instances.

I need two different servers looking at the same Hive metastore\DB. Any ideas how can i acomplish this ?

Re: How to add another HiveServer for current metastore ?

Adija1 — Tue, 01 Nov 2016 23:28:49 GMT

When i'm connected to the additional hiveserver and run beeline >>> show tables i get no tables

In the log it says:

2016-11-01 12:11:59,214 INFO [HiveServer2-Background-Pool: Thread-165]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=adijaip=unknown-ip-addr cmd=get_tables: db=default pat=.* 2016-11-01 12:11:59,229 WARN [HiveServer2-Background-Pool: Thread-165]: security.UserGroupInformation (UserGroupInformation.java:getGroupNames(1521)) - No groups available for user adija 2016-11-01 12:11:59,230 ERROR [HiveServer2-Background-Pool: Thread-165]: authorizer.RangerHiveAuthorizer (RangerHiveAuthorizer.java:filterListCmdObjects(430)) - filterListCmdObjects: Internal error: null RangerAccessResult object received back from isAccessAllowed()!

Re: How to add another HiveServer for current metastore ?

nsabharwal — Wed, 02 Nov 2016 00:36:01 GMT

@Adi Jabkowsky

Take a look on the error logs...

ERROR [HiveServer2-Background-Pool: Thread-165]: authorizer.RangerHiveAuthorizer (RangerHiveAuthorizer.java:filterListCmdObjects(430)) - filterListCmdObjects: Internal error: null RangerAccessResult object received back from isAccessAllowed()!

Re: How to add another HiveServer for current metastore ?

srai1 — Wed, 02 Nov 2016 01:30:38 GMT

good catch Neeraj. You can try disabling the ranger plugin via Ambari to test if it works otherwise.

Re: How to add another HiveServer for current metastore ?

Adija1 — Wed, 02 Nov 2016 13:58:01 GMT

@Neeraj Sabharwal

@srai

Thanks for the observation, i haven't considered this as a Ranger issue because it says that Access is allowed..

Anyways - disabling Ranger plugin fixed the issue.... but i need the Ranger plugin so i could manage Hive authorizations using Ranger.

Can't i use two HiveServer2 instances while managing hive auth using Ranger ??

Re: How to add another HiveServer for current metastore ?

Adija1 — Wed, 02 Nov 2016 23:32:19 GMT

I've noticed that in the new Edge running the HiveServer2 in /etc/hive/conf/conf.server the ranger-hive-audit.xml & ranger-hive-security.xml were configured with localhost values.

Fixed the issue by setting the server name instead of localhost in Ranger settings (Ambari) (External URL, authServiceHostName etc.)

Now the new server can contact the Ranger and Hive is working. Thank you for the heads up !

Re: How to add another HiveServer for current metastore ?

suresh_b_k — Tue, 24 Jan 2017 23:22:26 GMT

I face the same isssue. i have 2 HS2 server. Can't i use two HiveServer2 instances while managing hive auth using Ranger ??

Re: How to add another HiveServer for current metastore ?

Adija1 — Tue, 24 Jan 2017 23:28:28 GMT

@suresh krish

Please see my answer just above your comment:

"Fixed the issue by setting the server name instead of localhost in Ranger settings (Ambari) (External URL, authServiceHostName etc.)"

Re: How to add another HiveServer for current metastore ?

suresh_b_k — Tue, 24 Jan 2017 23:34:58 GMT

may i know the property please.. which property to change.

Re: How to add another HiveServer for current metastore ?

suresh_b_k — Tue, 24 Jan 2017 23:36:02 GMT

i dont find any local host entry in my configuration. all i see is sever name. no local host entries

Re: How to add another HiveServer for current metastore ?

Adija1 — Wed, 25 Jan 2017 01:07:40 GMT

In your second HS2 server go to /etc/hive/conf/conf.server , check for "localhost" properties there especially in ranger-hive-audit.xml & ranger-hive-security.xml

Re: How to add another HiveServer for current metastore ?

Adija1 — Wed, 25 Jan 2017 20:32:04 GMT

Also,

Make sure that in the Ranger's DB (the default is mysql) the user rangerlogger has permission to connect from the second Hive server.

Re: How to add another HiveServer for current metastore ?

Adija1 — Wed, 25 Jan 2017 20:36:28 GMT

@suresh krish

Also make sure that rangerlogger user has permissions to connect from the second hive server (in the Ranger's DB... the default is mysql).

The best way to do it is to try to connect to mysql on the first hive server from the second server using: mysql -u rangerlogger -p -h <second hive server>

If permissions is denied - then login to mysql using root and run the following:

GRANT ALL PRIVILEGES ON *.* TO 'rangerlogger'@'<second hive server>' IDENTIFIED BY '<PASSWORD>' WITH GRANT OPTION;

FLUSH PRIVILEGES;

Then check again.