question Re: How are offsets reset in kafka 0.11 in Archives of Support Questions (Read Only)

How are offsets reset in kafka 0.11

brajeshreddy — Thu, 31 May 2018 22:27:38 GMT

I'm using kafka 0.11. I'm trying to reset the offset of a topic in a consumer group but don't see consistency among the option. How is the offset calculated for different options in kafka-consumer-groups ?

user1@xxxxxxxxxxxx:~$ kafka-consumer-groups.sh --bootstrap-server xxxxxxxxxxxx.devkafka.com:9092 --group testgroup --reset-offsets--by-duration PT1H30M0S--topic Test_Upgrade --export --command-config client.properties 2>/dev/null

Test_Upgrade,1,615

Test_Upgrade,0,625

user1@xxxxxxxxxxxx:~$ dateThu May 31 15:30:45 BST 2018

user1@xxxxxxxxxxx:~$ kafka-consumer-groups.sh --bootstrap-server xxxxxxxxxxxx.devkafka.com:9092 --group testgroup --reset-offsets--to-datetime 2018-05-31T14:00:00.000--topic Test_Upgrade --export --command-config client.properties 2>/dev/null

Test_Upgrade,1,754

Test_Upgrade,0,772

Re: How are offsets reset in kafka 0.11

wcbdata — Fri, 01 Jun 2018 04:27:14 GMT

by-duration is specified relative to the current time, but --to-datetime is in UTC unless otherwise specified. Since you are on BST (British Summer Time), you'd need to use UTC+1, specifying "--to-datetime 2018-05-31T14:00:00.000+01" to get the same result - assuming I have my ISO standards right...

Re: How are offsets reset in kafka 0.11

brajeshreddy — Fri, 01 Jun 2018 17:16:57 GMT

Thanks @William Brooks will try that. From my initial checks, it seems working

Re: How are offsets reset in kafka 0.11

wcbdata — Fri, 01 Jun 2018 20:10:50 GMT

Glad it worked! If this answer helps, please mark it as an accepted answer, too!