question Re: How to configure Oozie and Hive High Availability without using Load Balancer in Archives of Support Questions (Read Only)

How to configure Oozie and Hive High Availability without using Load Balancer

sanjeevanmahaja — Fri, 12 Feb 2016 17:45:53 GMT

Can anyone share any documentation on configuring HA for Oozie and Hive without Load Balancer.

Re: How to configure Oozie and Hive High Availability without using Load Balancer

sanjeevanmahaja — Fri, 12 Feb 2016 17:51:04 GMT

Sorry there is typo in the question its without using Load Balancer

Re: How to configure Oozie and Hive High Availability without using Load Balancer

Shelton — Fri, 12 Feb 2016 18:18:29 GMT

@sanjeevan mahajan

Have a look at this document oozie and link

You can omit the HA setup steps.

Re: How to configure Oozie and Hive High Availability without using Load Balancer

bleonhardi — Fri, 12 Feb 2016 18:43:12 GMT

This is actually well explained in the ambari docs. Be sure to add the services extensions to make sure the two servers don't duplicate jobs

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_Ambari_Users_Guide/content/_adding_an_oozie_server_component.html

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_Ambari_Users_Guide/content/_hive_high_availability.html

Just as some comments: Without Load Balancer Oozie will continue to schedule jobs even if one server is down. But administration (submitting jobs ... ) would require you to point to the surviving oozie.

Also what the documents not describe is how to configure the underlying database in DR, that is your job. Here is an example for Postgres:

https://www.digitalocean.com/community/tutorials/how-to-set-up-master-slave-replication-on-postgresql-on-an-ubuntu-12-04-vps

However databases like Mysql and Postgres seem to be very stable so making for example Oozie Server HA is much more important than doing that for the underlying database. So you could decide to just backup the database regularly.

Re: How to configure Oozie and Hive High Availability without using Load Balancer

nsabharwal — Fri, 12 Feb 2016 18:46:54 GMT

I have fixed it for you @sanjeevan mahajan