we have worker machine in the ambari cluster that have faulty disk disk device name is /dev/sdb so we need to replace the faulty disk with a new disk what are the steps that need to do on the worker machine before replacing the disk and after replacing the disk ? ... View more

on all our kafka machines ( production machines ) , we see that: ( no free space ) df -h /var/kafka Filesystem Size Used Avail Use% Mounted on /dev/sdb 11T 11T 2.3M 100% /var/kafka and under /var/kafka/kafka-logs we see all topic folders (huge size) as example: 117G hgpo.llo.prmt.processed-28 117G hgpo.llo.prmt.processed-29 117G hgpo.llo.prmt.processed-3 117G hgpo.llo.prmt.processed-30 117G hgpo.llo.prmt.processed-31 117G hgpo.llo.prmt.processed-32 what is the best approach to delete the topic/s from the folder /var/kafka/kafka-logs , and what are the exactly steps to do so , as stop service before deletion etc . second important question: what is the mechanizem that suppose to delete automatically the topics ? ... View more

we want to set the parameter fs.trash.interval to zero as fs.trash.interval=o because when we delete files then files then they go to the trash example: hdfs dfs -rm -R /spark2-history/* and when we disable the fs.trash.interval , then files supposed to be delete without going to the trash we want to set the fs.trash.interval to zero because in our lab , HDFS usage became high on ambari dashboard and when we delete the files , actually files still stay in the trash and HDFS usage still high so i guess if we set the fs.trash.interval to zero then files will not get to the trash is it correct ? second by default fs.trash.interval=360 min is it really means that every 360 min ( interval ) , files will be delete from the trash? , or its depend on other scenario? ... View more