Member since
10-22-2015
241
Posts
86
Kudos Received
20
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1443 | 03-11-2018 12:01 AM | |
573 | 01-03-2017 10:48 PM | |
697 | 12-20-2016 11:11 PM | |
1855 | 09-03-2016 01:57 AM | |
654 | 09-02-2016 04:55 PM |
01-03-2017
10:48 PM
1 Kudo
I would say it is not recommended (I am the person who ported MOB to HDP) There hasn't been any testing on using 2.5 jars on top of 2.4 Is there particular reason why the customer cannot upgrade to 2.5 ? Thanks
... View more
12-20-2016
11:13 PM
servlet-api-2.5.jar is brought in by transitive dependency: [INFO] +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.7.3.2.6.0.0-SNAPSHOT:compile [INFO] | +- org.apache.hadoop:hadoop-yarn-common:jar:2.7.3.2.6.0.0-SNAPSHOT:compile [INFO] | | +- javax.xml.bind:jaxb-api:jar:2.2.2:compile [INFO] | | | \- javax.activation:activation:jar:1.1:compile [INFO] | | +- javax.servlet:servlet-api:jar:2.5:compile
... View more
12-20-2016
11:11 PM
1 Kudo
netty-3.2.4.Final.jar is brought in by hbase-it module. It shouldn't collide with netty-all-4.0.23.Final.jar
... View more
09-17-2016
08:09 PM
1 Kudo
You can take a look at: http://hbase.apache.org/book.html#ops.snapshots Especially: http://hbase.apache.org/book.html#ops.snapshots.export The backup / restore feature in HDP 2.5 makes backing up multiple tables easy to operate.
... View more
09-06-2016
06:10 PM
1 Kudo
How many regions are there for this table ? What's the value for hbase.hregion.max.filesize ? Thanks
... View more
09-06-2016
06:09 PM
Can you attach region server log for the server which hosts the single large region ? There should be some clue in the region server log.
... View more
09-06-2016
06:05 PM
For HDP 2.3 (Apache 1.1.2), ./hbase-common/src/main/java/org/apache/hadoop/hbase/HBaseConfiguration.java calls HeapMemorySizeUtil.checkForClusterFreeMemoryLimit(conf); There is no HBaseConfiguration.checkForClusterFreeMemoryLimit Can you double check your classpath to see which hbase related jars are present. Please pastebin those jars Thanks
... View more
09-06-2016
04:39 PM
Please check the value of hbase.regionserver.global.memstore.upperLimit
... View more
09-03-2016
01:57 AM
1 Kudo
Which user did you use to run the code ? What's the output of the following command ? klist -kt /etc/security/keytabs/hbase.service.keytab Normally hbase.service.keytab should be used by user 'hbase'. Please illustrate your use case in more detail. Please take a look at hbase-common/src/main/java/org/apache/hadoop/hbase/AuthUtil.java
... View more
09-02-2016
04:55 PM
1 Kudo
Pig doesn't support creating hbase table. Please pre-create table in hbase.
... View more
09-01-2016
05:55 PM
We need more of the master log beyond what tail showed us. Please attach master log.
... View more
09-01-2016
03:47 PM
Can you attach the master log so that we can better help you ? You can add hbase.master.namespace.init.timeout to hbase-site.xml by using Ambari. Still, finding the root cause is desirable.
... View more
09-01-2016
02:29 PM
1 Kudo
@dengke li Can you attach master log ? You should find it under /grid/0/log/hbase/ Consider increasing hbase.master.namespace.init.timeout Default is 300000 ms
... View more
08-30-2016
03:52 PM
NoRouteToHostException occurred in both region server and node manager logs. Please check network connectivity.
... View more
08-30-2016
02:53 PM
w.r.t. AWS instance check failure, have you looked at http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/TroubleshootingInstances.html
... View more
08-29-2016
05:49 PM
1 Kudo
Zack: Can you check other regions which failed to open (such as a97029c18889b3b3168d11f910ef04ae ) ?
... View more
08-29-2016
05:47 PM
1 Kudo
Zack: You can use hfile tool to inspect: MY_BROKEN_TABLE/8a444fa1979524e97eb002ce8aa2d7aa/0/4f9a5c26ddb0413aa4eb64a869ab4a2c http://hbase.apache.org/book.html#hfile_tool
... View more
08-29-2016
01:53 AM
'hbase.master.logcleaner.plugins' is not overridden in hbase-site.xml Need to investigate further.
... View more
08-26-2016
10:12 PM
Snippet from master log: http://pastebin.com/4iv5YKEQ Here is related code: String plugins = conf.get(HBASE_MASTER_LOGCLEANER_PLUGINS); Looks like the value for "hbase.master.logcleaner.plugins" was null - default should be org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner Can you attach hbase-site.xml ? Thanks
... View more
08-22-2016
03:48 PM
I have sent an email to Roshan who is more familiar with Flume component.
... View more
08-22-2016
02:59 PM
Here is the code in HBaseSink.java: if (r instanceof Put) { ((Put) r).setWriteToWAL(enableWal); Here is code in Put.java of HDP 2.3: public Put setWriteToWAL(boolean write) { return (Put) super.setWriteToWAL(write); In pom.xml of Flume in HDP 2.3: <hbaseversion>0.94.2</hbaseversion> Planning to raise an internal JIRA for this incompatibility.
... View more
08-22-2016
02:54 PM
For #2, this is currently not possible. You need to upgrade the whole stack.
... View more
08-18-2016
08:59 PM
2 Kudos
The installation is controlled by the rpm packages. It is hard coded to /usr/hdp
... View more
08-17-2016
09:45 PM
Can you provide more information (attaching region server log) ? Load balancer wouldn't create new region.
... View more
08-01-2016
08:04 AM
2 Kudos
One aspect to note w.r.t. using PrefixFilter is that the start row is not automatically set. You need to pass the correct start row along with PrefixFilter. Otherwise the number of rows scanned may be quite high.
... View more
07-29-2016
10:47 AM
1 Kudo
@Ashnee: You can also use snapshot for table backup: http://hbase.apache.org/book.html#ops.snapshots
... View more
07-21-2016
02:31 PM
1 Kudo
ACLs were not part of the core hbase (implemented through coprocessor). We were adding to a core functionality knowledge about an external component (ACL). There was the discussion about the meaning of restoring the acls that we snapshotted (see HBASE-11013). Please consult with the following for up-to-date ACL: http://hbase.apache.org/book.html#appendix_acl_matrix We cannot allow any user to restore any snapshot otherwise you'll be able to see data that is not yours. There is no ACL on snapshot to say "allow this user to restore/clone" the snapshot.
... View more