About mike_bronson7

mike_bronson7 · ‎05-16-2018

regardint " Clean kafka log dir (specified by the log.dir attribute in kafka config file ) as well the zookeeper data" do you mean to delete all 00000000000000000000.index 00000000000000000000.log 00000000000000000000.timeindex from /var/kafka/kafka-logs/ ?

mike_bronson7 · ‎05-16-2018

regarding to "How to delete data from topic" can we get step by step procedure . as you know we not want to delete the Topic or Topic partitions ,

mike_bronson7 · ‎05-16-2018

just one important note - we have 3 kafka kafka01/03 are have the problem with broker restart but not on kafka02 , so my quastion is can we purge on kafka02 , and this will efected also kafka01/03

mike_bronson7 · ‎05-16-2018

@Geoffrey you know any check that fives ok/fail after : or tell us if purge success? /usr/hdp/2.6.0.3-8/kafka/bin/kafka-topics.sh --zookeeper master:2181--alter --topic Topic_Name--config retention.ms=1000

mike_bronson7 · ‎05-16-2018

any option to hold the kafka to stay up ?

mike_bronson7 · ‎05-16-2018

the reason that we want to purge all topic is because the restart of the kafka broker , many indexes are corupted and maybe log files

mike_bronson7 · ‎05-16-2018

regarding "I highly doubt whether you can delete or purge the topics when the broker is down" , so what we can do ? we cant fixed the kafka broker restart , how we can be sure the purge will do the job inspite broker is down?

mike_bronson7 · ‎05-16-2018

we have hadoop cluster with 3 kafka machines we want to purge all the topics in the kafka as the following /usr/hdp/2.6.0.3-8/kafka/bin/kafka-topics.sh --zookeeper master:2181 --alter --topic Topic_Name --config retention.ms=1000 the problem is that two of the kafka machines have a problem that kafka broker on kafka01/02 restarting all the time , or kafka broker is down on kadka01/03 so my question is: can we purge Topics in spite kafka broker is down ?

mike_bronson7 · ‎05-14-2018

meenwhile we only move the index files and start the kafka , what you think about ?

mike_bronson7 · ‎05-14-2018

I will check that but can we also to delete all files that are ended with ".index" ?

Online	Offline
Last Visited	‎08-27-2024 09:17 AM

Member Since	‎08-08-2017 09:40 AM
Last Visited	‎08-27-2024 09:17 AM
Posts	1,652
Kudos received	29

Cloudera Community

Re: how to find number of CPU core on datanode ma...

Re: postgresql + ambari server failed to open port...

Re: how to stop the thrift servers by REST API

Re: namenode is in safe mode

Re: Directory /grid/sdg/hadoop/hdfs/data became un...

Re: is it possible to purge topic when kafka broke...

Re: is it possible to purge topic when kafka broke...

Re: is it possible to purge topic when kafka broke...

Re: is it possible to purge topic when kafka broke...

Re: is it possible to purge topic when kafka broke...

Re: is it possible to purge topic when kafka broke...

Re: is it possible to purge topic when kafka broke...

is it possible to purge topic when kafka broker is...

Re: kafka + kafka shutdown because InvalidOffsetEx...

Re: kafka + kafka shutdown because InvalidOffsetEx...