Support Questions
Find answers, ask questions, and share your expertise

Nifi ListSTP SubFolder Filter not working

Nifi ListSTP SubFolder Filter not working

New Contributor

Hi , I was trying to list down the files using the ListSFTP in Nifi , my current (main) directory has almost 10K+ folders , searching and listing down the files is taking almost 1.5 hours(using recursion) which is not a correct solution for me, so i decided to do it based on SubFolder filter. (categorize the folders and open multiple list programs)


I have tried using "Path Filter Regex" to filter subfolders,for some reason it is not listing down any files.

Can someone please help me.


Nifi Version : Apache NiFi - Version 1.5.0.3.1.0.0-564


my folder structure


Parent Folder:


XXXXXX/YYYY/Main


Sub Folders (10K+)

sample folder name : ( Yes, folder name has comma, _ ,= )

"Subtype=ONM_ROY_MI,SubType=The_XYZ,MeContext=ABCPNBULE02323269"


Each folder has around 10 to 15 files... with format "A*.bin.gz"


Thanks

Venkat



Don't have an account?