I have storm topology, which reads messages from kafka, does a lookup from hbase table, apply some business login on message and update hbase table!cBelow are steps, how a message flow from kafka to hbase happens in my storm topolgy!!
Issue Storm hbase lookup bolt is reading wrong value from the HBase table!
To explain in more detail:
when incoming messages arrive at a time gap of few milli secs to secs, "HBaseLookupBolt" is reading old value from HBase table, even though the table is updated already using "HBaseBolt" !!!
Can someone please share your thoughts, on how can i ensure lookup bolt takes the right value ?
Or is it possible thru any setting, to slow down the speed at which storm processes the records or any other of your valuable thoughts.... ?
hi @Ajay, i am using storm-hbase connector api, which comes with Storm version 0.10.0.2.3.4.21-2.
And i have checked the source code of it, it does update for every record it processes!!
I am NOT using Phoenix.
@Raja A There are couple of open libs for Storm-Hbase connector. Which one you are using?
If you are using HBaseBolt with TupleTableConfig class,try setting batching to false. (i.e setBatch(false)) By default it is true.