Member since
07-17-2019
738
Posts
433
Kudos Received
111
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3478 | 08-06-2019 07:09 PM | |
| 3678 | 07-19-2019 01:57 PM | |
| 5208 | 02-25-2019 04:47 PM | |
| 4674 | 10-11-2018 02:47 PM | |
| 1772 | 09-26-2018 02:49 PM |
02-07-2017
06:41 PM
s/HBASEMANTERHOST/HBASEMASTERHOST/? Users would be filling in the explicit hostname here, correct? Not the literal string "HBASEMASTERHOST".
... View more
02-07-2017
05:12 PM
Caused by: java.lang.ArrayIndexOutOfBoundsException: 3
at org.apache.hadoop.net.DNS.reverseDns(DNS.java:82)
at org.apache.hadoop.net.DNS.getHosts(DNS.java:253)
at org.apache.hadoop.net.DNS.getDefaultHost(DNS.java:366)
... 21 more The code is doing the following: 1. Taking the specified interface name (or "default" if not specified) and fetches the InetAddress's for that interface 2. For each InetAddress, split the result from `getHostAddress()` on "." and generate the reverse IP. e.g. for "10.0.0.1", generate "1.0.0.10.in-addr.arpa" Sadly, there isn't any logging here to make this easy. It might be something as simple as an IPv6 address being used instead. You could try to add the following to HBASE_MASTER_OPTS and HBASE_REGIONSERVER_OPTS in hbase-env.sh: -Djava.net.preferIPv4Stack=true
I don't have another suggestion off the top of my head..
... View more
02-07-2017
04:00 PM
The interface specification you provided is used by HBase to
determine its hostname. Because we're specifying the bind-all IP address
(0.0.0.0) and you have multiple interfaces, we can't definitively know which one we're supposed to use for HBase services to advertise themselves. What should be happening is that the IP address for that interface is looked up, and then an rDNS call is made to figure out the hostname for that address. Part of your issue might be trying to use separate hostnames for the different networks. This inherently doesn't work in scenarios where Kerberos is configured, so perhaps you are running into convention-based issues. As a general rule, the hostname for a server should be consistent regardless of where the client is coming from. In other words, you shouldn't have "server03" and "server03int", just "server03". Your DNS server determines what IP address to return based on where the client is coming from (external or internal). I'll have to look at the source code to figure out what was missing that caused the ArrayIndexOutOfBoundsException and get back to you.
... View more
02-07-2017
12:12 AM
Nothing jumped out at me from your logs. Sorry I can't be of help with the information you provided. You should consider exercising your HDP support contract if you need more help.
... View more
02-06-2017
03:51 PM
Connection refused means that your client cannot connect to the port on that host. That means there is either no port open on that machine or something is preventing you from connecting to it. If there is a firewall in place like you alluded to, it sounds like you need to talk to your system administrators. We can't fix that for you..
... View more
02-06-2017
03:50 PM
First, please familiarize yourself with the write-up here: https://community.hortonworks.com/articles/24277/parameters-for-multi-homing.html Even when you have multiple interfaces, you should have a consistent hostname for a single machine. Depending on where a client tries to access that machine from (the network path required to access that machines), DNS must return the correct IP address so that the client can communicate with that machine. e.g. If the client is accessing the machine from the public network, the hostname should resolve to a public network IP address. To have HBase listen on multiple interfaces, make sure that you specify 0.0.0.0 as the bind address as declared in the above document.
... View more
01-30-2017
06:15 PM
1 Kudo
1. Yes, HBase only requires HDFS and ZooKeeper to function. YARN is not required. 2. This question is nonsensical. The Namenode is not an optional component of HDFS. 3. Use Ambari to install the cluster Please read the official HBase book to better understand the architecture. These basics are covered there. http://hbase.apache.org/book.html
... View more
01-30-2017
04:04 PM
@Sumit Nigam your trimming of the logs removes the ability for us to actually figure out what's going on. You have redacted much of the important information.
... View more
01-27-2017
04:55 PM
1 Kudo
I would strongly recommend the use of Ambari to manage your HDP clusters. If you need to automate the installation of multiple HDP clusters, Ambari blueprints are a very nice feature to reduce the cost of re-installation.
... View more
01-23-2017
09:20 PM
3 Kudos
I would guess that the problem is that you are not explicitly providing a :key column which makes your value actually have 10+1 entries instead of just 10. You will want to map one of the Hive columns you are selecting into the HBase rowKey. This is done by including a ":key" entry in the value for "hbase.columns.mapping". This is what defines uniqueness in each record. See https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration#HBaseIntegration-ColumnMapping for more information.
... View more