Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can we configure HBase to use multiple WAL Codecs?

Solved Go to solution

Can we configure HBase to use multiple WAL Codecs?

Contributor

We have a customer who wants to enable HBase to use multiple WAL Codecs at the same time. Is this possible?

E.g. Phoenix configuration instructions ask the user to update the value for hbase.regionserver.wal.codec. However, the customer also wants to use the NGData HBase/Solr Indexer which also requires a custom value for h.r.wal.code.

Can HBase RegionServer configuration accommodate two WAL codecs in parallel?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Can we configure HBase to use multiple WAL Codecs?

Guru

It is not possible to use more than one WAL Codec at a time since it is the WALCodec which decides on the binary layout of the cells in WAL files.

Phoenix uses the WAL Codec for secondary indexing. It should be possible to run Phoenix without the WAL Codec if secondary indexing in Phoenix is not used.

3 REPLIES 3
Highlighted

Re: Can we configure HBase to use multiple WAL Codecs?

Guru

It is not possible to use more than one WAL Codec at a time since it is the WALCodec which decides on the binary layout of the cells in WAL files.

Phoenix uses the WAL Codec for secondary indexing. It should be possible to run Phoenix without the WAL Codec if secondary indexing in Phoenix is not used.

Re: Can we configure HBase to use multiple WAL Codecs?

@Wes Floyd

I'm not expert in this subject, but looks like HDP Search - Hbase connector uses replication and not WAL Codec, this way I think you can use both, Solr Connector + Phoenix.

https://doc.lucidworks.com/lucidworks-hdpsearch/2.3/Guide-Jobs.html#_how-the-hbase-indexer-works

Re: Can we configure HBase to use multiple WAL Codecs?

Contributor

Great point @Guilherme Braccialli ! I'll investigate and offer this to the customer.

Don't have an account?
Coming from Hortonworks? Activate your account here