Support Questions
Find answers, ask questions, and share your expertise

Flume + Kafka Property offsets.storage

Highlighted

Flume + Kafka Property offsets.storage

New Contributor

Hi everybody, 

I would like to know how can I put Flume Kafka Source  (consumer)  with the property
"offsets.storage=kafka" which was released in kafka 0.8.2.2.

The current Flume 1.6 seems to be compiled with Kafka 0.8.1.1 where this property doesn't exist, and I get the warning:
kafka.utils.VerifiableProperties: Property offsets.storage is not valid

Is in the roadmap have support to the new Kafka 0.9 o at least 0.8.2.2 in order get this feature?

I have got many issues with the offset storage in zookeeper when Flume is working for about 5 days.


Thank you



 

Don't have an account?