How can i consume kafka offsets based on timestamp?

sanjeev_verma82 — Wed, 01 Jun 2016 19:07:19 GMT

Re: How can i consume kafka offsets based on timestamp?

rajkumar_singh — Wed, 01 Jun 2016 19:17:20 GMT

if you commit the offset based on timestamp you can start consuming from kafka at next batch cycle

like this

--commit last consumed consumer = KafkaConsumer(bootstrap_servers='localhost:9092')

tp = TopicPartition(topic, partition) consumer.seek(tp, end) consumer.commit() --now start consuming offset from Kafka when the job restarts at the next batch cycle: consumer.assign([tp])

start = consumer.committed(tp)

question How can i consume kafka offsets based on timestamp? in Archives of Support Questions (Read Only)

How can i consume kafka offsets based on timestamp?

Re: How can i consume kafka offsets based on timestamp?