Member since
09-25-2015
82
Posts
93
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3848 | 06-06-2017 09:57 AM | |
1066 | 03-01-2017 10:26 AM | |
1083 | 11-22-2016 10:32 AM | |
902 | 08-09-2016 12:05 PM | |
1579 | 08-08-2016 03:57 PM |
12-04-2015
05:15 PM
2 Kudos
@Arpit Agarwal Thanks for helping me out. For others' information: ~50% of dfs.namenode.handler.count is a reasonable value for dfs.namenode.service.handler.count.
... View more
11-25-2015
12:25 PM
2 Kudos
How should we reassign the current number of hdfs.namenode.handler.count to dfs.namenode.service.handler.count and hdfs.namenode.handler.count after activating service RPC? For instance, we currently having 240 handler threads - should we set dfs.namenode.service.handler.count to 120 and hdfs.namenode.handler.count to 120 or do you suggest other ratios?
... View more
Labels:
- Labels:
-
Apache Hadoop
10-15-2015
04:11 PM
works perfectly now, thanks!
... View more
10-15-2015
08:38 AM
Unfortunately that seems not to work. Does it make a difference to the URL if hiveserver2 is in http transport mode? You don't have to add that in somewhere like you do in a normal beeline connection string?
... View more
10-13-2015
04:06 PM
I'll try it, thanks!
... View more
10-13-2015
03:44 PM
4 Kudos
Hi, I am trying to set up zookeeper discovery for HS2 and I am getting various connection errors when I try to connect via beeline. The following is the connection string. !connect jdbc:hive2://host1.com:2181,host2.com:2181,host3.com:2181;serviceDiscoveryMode=zooKeeper; zooKeeperNamespace=hiveserver2 I am following this documentation. Can anyone confirm if there are any other steps/configs required? Is the connection string wrong perhaps? Does HS2 need to run in http mode or is binary ok?
Configuration Requirements 1. Set hive.zookeeper.quorum to the ZooKeeper ensemble (a comma separated list of ZooKeeper server host:ports running at the cluster) 2. Customize hive.zookeeper.session.timeout so that it closes the connection between the HiveServer2’s client and ZooKeeper if a heartbeat is not received within the timeout period. 3. Set hive.server2.support.dynamic.service.discovery to true 4. Set hive.server2.zookeeper.namespace to the value that you want to use as the root namespace on ZooKeeper. The default value is hiveserver2. 5. The adminstrator should ensure that the ZooKeeper service is running on the cluster, and that each HiveServer2 instance gets a unique host:port combination to bind to upon startup.
... View more
Labels:
- Labels:
-
Apache Hive
10-07-2015
08:17 AM
Ah! Ok, I had misunderstood that part of the HS2 HA. Thanks for clarifying!
... View more
10-06-2015
04:43 PM
That's what i figured if they set up ZK discovery - so you're saying you do have to have ZK discovery set up? There's no other way?
... View more
10-06-2015
03:59 PM
6 Kudos
Hi @mparikh@hortonworks.com: Instructions for adding SmartSense to Ambari are listed in the SmartSense documentation, however I will reproduce that here for clarity. FYI this is for the current latest version of SmartSense (1.1.0) 1) Install SmartSense Package on the Ambari Server host
RHEL / CentOS 2) Add the SmartSense Ambari integrations to the existing Ambari Installation # hst add-to-ambari
Enter SmartSense distributable path: {Full path to package from Step 1}
It is required to restart Ambari server for changes to reflect. Do you want to restart Ambari server? [y/n] (default: n): {y}
Restarting Ambari server. 3) From Ambari Web UI, select Add Service from the Actions dropdown menu. 4) From the list of installable services, select SmartSense. 5) In the Assign Masters step, select a cluster node for the HST Server. 6) In the Customize Services step, there are three required fields, and three fields that should be
reviewed before proceeding 7) Once the fields above have been validated, click Next 😎 In the Review step, click Deploy to complete your SmartSense Service installation.
9) After the SmartSense service has been successfully added to Ambari, the Ambari server must be
restarted to load the SmartSense view. Restart the Ambari Server by executing the following
command: # ambari-server restart You will then see the SmartSense View in the menu with all your other Ambari Views.
... View more
10-06-2015
03:47 PM
1 Kudo
Hi, How do you configure a Ranger Hive repository if you have two instances of HiveServer2 running in a cluster? I'm assuming you don't create a separate repository for each one, so which jdbc URL do you provide to the repository configs? Do you perhaps have to have Zookeeper discovery enabled and then use that URL? What happens if you don't want to use the multiple HS2 instances in a failover kind of structure, but rather have them as two separate processes running at the same time? Is such a thing supported? Thanks in advance, Ana EDIT: This post here has a great explanation of different JDBC URLs for ZK discovery: http://community.hortonworks.com/questions/1342/how-to-enable-zookeeper-discovery-for-hiveserver2.html
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Apache Ranger
- « Previous
- Next »