Created 10-27-2015 07:47 AM
Hi
Does CDH 5.4.2 support HiveServer2 high availability? https://issues.apache.org/jira/browse/HIVE-7935
jdbc:hive2://<zookeeperServer1>:port,<zookeeperServer2>:port,<zookeeperServer3>:port/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
I cant find any references in http://www.cloudera.com/content/www/en-us/documentation/cdh/5-0-x/CDH5-Installation-Guide/cdh5ig_hiv...
Regards
Deenar
Created on 11-04-2015 10:43 PM - edited 11-04-2015 11:39 PM
like hiveserver2 do not register it's self to zookeeper, but how to config it ?
Created 11-04-2015 11:39 PM
i got it.
use cloudera manager:
1、open hive -> Configuration -> Category -> Advanced
2、find "HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml"
3、write:
<property>
<name>hive.server2.support.dynamic.service.discovery</name>
<value>true</value>
</property>
4、restart and hiveserver2 is register to zookeeper.
Created 11-05-2015 01:32 AM
Have you tried it on your cluster and does it work fine. I know about this property. I was wondering if this supported on CDH 5.4.0 ?
Created 11-05-2015 04:54 AM
sorry, i only tried it with cdh5.4.8 and i don't have cdh5.4.0 cluster.
Created 11-05-2015 08:19 AM
Created 11-06-2015 08:11 AM
Thanks guys
Created 11-06-2015 04:52 PM
I am a PM working on Hive at Cloudera. Since HS2 HA (dynamic service discovery) has significant known issues, we don't consider it production ready or supported as specified in release notes for CDH 5.4. Therefore, this experimental feature is not supported in any CDH release.
For our customers, Hive workloads often constitute the backbone of their data infrastructure. Consequently, stability and reliability of Hive components are of utmost importance. Customers should use an experimental feature e.g. HS2 HA only under the guidance of our technical experts. Customers have access to internal reference docs for such features. If you are a customer, please contact your Cloudera account manager for further details and technical guidance.
Created 11-07-2015 12:35 AM
This is a good answer !
I work for a paying Cloudera Customer, I am experimenting new features to propose future enhancements. I was experimenting with HA HS2, and was choosing over separate HS2 servers (externally balanced via HAProxy or Netscaler) or using this way. OK, separate HS2 are not proper HA, but sort of.
Since this sounded better to me, just because we are using zookeeper and not an external software, I was searching for info.
Anyway, do you have any foreseen about CDH version supporting this ? Would it be in any problem with Metastore HA + Sentry service + CM ACL plugin, which is also unsupported ?
I asked to the support and they offer to send me the local support agent: I don't want support for implementing it, I just want to know if it makes sense for me to investigate it, since it will supported soon. This way I can tell my client that experimentation makes sense, hope you understand what I mean.
Bye
Omar
Created 11-10-2015 07:11 PM