- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Can we configure HBase to use multiple WAL Codecs?
- Labels:
-
Apache HBase
-
Apache Phoenix
Created 01-26-2016 12:41 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We have a customer who wants to enable HBase to use multiple WAL Codecs at the same time. Is this possible?
E.g. Phoenix configuration instructions ask the user to update the value for hbase.regionserver.wal.codec. However, the customer also wants to use the NGData HBase/Solr Indexer which also requires a custom value for h.r.wal.code.
Can HBase RegionServer configuration accommodate two WAL codecs in parallel?
Created 01-26-2016 01:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It is not possible to use more than one WAL Codec at a time since it is the WALCodec which decides on the binary layout of the cells in WAL files.
Phoenix uses the WAL Codec for secondary indexing. It should be possible to run Phoenix without the WAL Codec if secondary indexing in Phoenix is not used.
Created 01-26-2016 01:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It is not possible to use more than one WAL Codec at a time since it is the WALCodec which decides on the binary layout of the cells in WAL files.
Phoenix uses the WAL Codec for secondary indexing. It should be possible to run Phoenix without the WAL Codec if secondary indexing in Phoenix is not used.
Created 01-26-2016 01:45 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I'm not expert in this subject, but looks like HDP Search - Hbase connector uses replication and not WAL Codec, this way I think you can use both, Solr Connector + Phoenix.
https://doc.lucidworks.com/lucidworks-hdpsearch/2.3/Guide-Jobs.html#_how-the-hbase-indexer-works
Created 01-26-2016 03:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Great point @Guilherme Braccialli ! I'll investigate and offer this to the customer.
