Member since
10-03-2021
3
Posts
0
Kudos Received
0
Solutions
10-21-2021
12:49 AM
@DA-Ka You need to use HDFS Find tool "org.apache.solr.hadoop.HdfsFindTool" for that purpose. Refer below links which suggests some method to fid the old Files. - http://35.204.180.114/static/help/topics/search_hdfsfindtool.html However, the search-based HDFS find tool has been removed and is superseded in CDH 6 by the native "hdfs dfs -find" command, documented here: https://hadoop.apache.org/docs/r3.1.2/hadoop-project-dist/hadoop-common/FileSystemShell.html#find
... View more
10-17-2021
11:32 PM
@DA-Ka, Has the reply helped resolve your issue? If so, kindly mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
10-03-2021
11:54 PM
Hello @DA-Ka The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. du -sh /kafka-logs/*
... View more