Member since
09-28-2018
1
Post
0
Kudos Received
0
Solutions
09-28-2018
09:32 PM
How can we overcome known bug related to file filtering on recursive listing in ListHDFS? We are trying to filter out the specific files within subdirectories found under a recursive directory listing. We have testing the bug in NiFi 1.5 and 1.7. We are using ListHDFS to find any file that's been added under the parentdir directory tree and filter out for *.CSV. There is a NiFi bug that won't allow filtering within subdirectories. Has anyone been able to do this? Goal: get the list of all *.csv files under the parentdir directory. Example: /parentdir/subdir1/subdir1/subdir1/file1.txt /parentdir/subdir1/subdir1/subdir1/file2.txt /parentdir/subdir1/subdir1/subdir1/xfile1.csv /parentdir/subdir1/subdir1/subdir1/xfile2.csv /parentdir/subdir1/subdir2/subdir6/file1.txt
/parentdir/subdir1/subdir2/subdir6/file2.txt /parentdir/subdir1/subdir2/subdir6/xfile1.csv /parentdir/subdir1/subdir2/subdir6/xfile2.csv Please help!
... View more
Labels:
- Labels:
-
Apache Hadoop