Support Questions

Find answers, ask questions, and share your expertise

what is the procedure when kafka disk crashed

hi all



we have 3 kafka machine in the HDP cluster

each kafka machine have disk with 18T

the last kafka machines loose the disk ( disk isn't healthy , and we need to replace it )

so we replaced the disk , and we create again the file-system on it and create again the topics


but - as all know before removing the kafka data from the topics , we need to delete all topics in the /var/kafka-kafka-logs

and then it is safe to replace the disk


but this isn't the case because suddenly disk creased and we not deleted the topics

for now kafka broker service stooped after some time , and we think it is because the topics that are not removed before disk replacing


any suggesting regarding this case ?



example how to delete the topic - PlR_TGE_FDS ( that we not did ) , and another 23 topics that not deleted


/usr/hdp/current/kafka-broker/bin/kafka-topics.sh --zookeeper zookeper_server01:2181 --delete --topic PlR_TGE_FDS


Michael-Bronson
1 REPLY 1

The above was originally posted in the Community Help Track. On Wed May 22 02:54:30 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself.

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.