Support Questions

Find answers, ask questions, and share your expertise

Ability to Edit/Fetch the kafka offsets stored in zookeeper - "storm-kafka" integration library!!

avatar
Expert Contributor

Hi,

Would it be possible to see the offsets committed to zookeeper of a kafka topic when we consumer it using "storm-kafka" integration & is it possbile to edit the offset committed to zookeeper to re-consume the topic messages again?

And can someone help me identify,

Which class of "storm-kafka" does actually write/commits the offset to zookeeper ? &

which class actually fetches the last committed offset when we re-run a storm topology with same client id ?

Thanks a lot.

1 ACCEPTED SOLUTION
10 REPLIES 10

avatar
Rising Star

@Raja A Not that i know of. You can edit the offsets using command line zookeeper client. In a test or dev setup this should be fine. I would not advise it in a production environment unless you know for sure that updating the offsets will not cause storm application to skip data for processing.