- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HBaseSink HDP 2.3.2 HBase client version
- Labels:
-
Apache Flume
-
Apache HBase
Created ‎08-19-2016 01:05 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We recently upgraded from HDP 2.1.4 to HDP 2.3.2 and I have some Flume agents that use HBaseSink to publish logs to HBase. After the upgrade I've been receiving the error found below. I compiled my customer event serializer for my events against HBase version 1.1.2.2.3.2.0-2950 and Hadoop version 2.7.1.2.3.2.0-2950 but something still isn't right. Is there something special I need to do to get this working? HDP 2.3.2 contains HBase 1.1.2 + Hadoop 2.7.1 + Flume 1.5.2
18 Aug 2016 19:02:24,873 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.hbase.HBaseSink.process:356) - Failed to commit transaction.Transaction rolled back. java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.Put.setWriteToWAL(Z)V at org.apache.flume.sink.hbase.HBaseSink$3.run(HBaseSink.java:379) at org.apache.flume.sink.hbase.HBaseSink$3.run(HBaseSink.java:374) at org.apache.flume.sink.hbase.HBaseSink.runPrivileged(HBaseSink.java:427) at org.apache.flume.sink.hbase.HBaseSink.putEventsAndCommit(HBaseSink.java:374) at org.apache.flume.sink.hbase.HBaseSink.process(HBaseSink.java:344) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) at java.lang.Thread.run(Thread.java:745)
Created ‎08-19-2016 01:32 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
org.apache.hadoop.hbase.client.Put.setWriteToWAL(Z)V
That is Flume client issue, version is not compatible with HBase 1.1.2. Make sure you use right version of Flume and if it comes with HBDP 2.3.2, then issue should be raised on Flume/HBase incompatibility.
Created ‎08-19-2016 01:32 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
org.apache.hadoop.hbase.client.Put.setWriteToWAL(Z)V
That is Flume client issue, version is not compatible with HBase 1.1.2. Make sure you use right version of Flume and if it comes with HBDP 2.3.2, then issue should be raised on Flume/HBase incompatibility.
