Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 12-01-2017 11:17 AM
we do the following steps in order to delete the topic - hgpo.llo.prmt.processed
but even after 12 hours topics folders still not deleted from /var/kafka/kafka-logs
note - we set - delete.topic.enable=true
hkafka01 kafka-logs]# /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --zookeeper master01:2181 --alter --topic hgpo.llo.prmt.processed--config retention.ms=1000 WARNING: Altering topic configuration from this script has been deprecated and may be removed in future releases. Going forward, please use kafka-configs.sh for this functionality Updated config for topic "hgpo.llo.prmt.processedd" kafka01 kafka-logs]# /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --zookeeper master01:2181 --delete --topic hgpo.llo.prmt.processed Topic hgpo.llo.prmt.processed is already marked for deletion.
how to force the topic deletion ?
on kafka machine ( production machine ) , we see that: ( no free space )
/dev/sdb 15500450528 15500434144 0 100% /var/kafka
and under /var/kafka/kafka-logs , we still see all topic folders (huge size) as example: ( down )
so is it possible just to remove these folders as example - by rm -rf hgpo.llo.prmt.processed-28 ?
under /var/kafka/kafka-logs we have many topic folders as :
117G hgpo.llo.prmt.processed-28 117G hgpo.llo.prmt.processed-29 117G hgpo.llo.prmt.processed-3 117G hgpo.llo.prmt.processed-30 117G hgpo.llo.prmt.processed-31 117G hgpo.llo.prmt.processed-32 . . . . .
Created 12-01-2017 11:22 PM
Is topic deletion enabled at the broker level (delete.topic.enable=true) in the entire cluster, and did you restart it if you did enable it?
Maybe since the disk is full, Kafka and related services are refusing to start. Have you verified there are such processes running on the machine?
The nuclear, manual option would be to delete the topic data from the broker, but you must also purge the Zookeeper records for this topic
Created 12-01-2017 11:22 PM
Is topic deletion enabled at the broker level (delete.topic.enable=true) in the entire cluster, and did you restart it if you did enable it?
Maybe since the disk is full, Kafka and related services are refusing to start. Have you verified there are such processes running on the machine?
The nuclear, manual option would be to delete the topic data from the broker, but you must also purge the Zookeeper records for this topic
Created 12-02-2017 07:00 PM