Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi ListSTP SubFolder Filter not working

Highlighted

Nifi ListSTP SubFolder Filter not working

New Contributor

Hi , I was trying to list down the files using the ListSFTP in Nifi , my current (main) directory has almost 10K+ folders , searching and listing down the files is taking almost 1.5 hours(using recursion) which is not a correct solution for me, so i decided to do it based on SubFolder filter. (categorize the folders and open multiple list programs)


I have tried using "Path Filter Regex" to filter subfolders,for some reason it is not listing down any files.

Can someone please help me.


Nifi Version : Apache NiFi - Version 1.5.0.3.1.0.0-564


my folder structure


Parent Folder:


XXXXXX/YYYY/Main


Sub Folders (10K+)

sample folder name : ( Yes, folder name has comma, _ ,= )

"Subtype=ONM_ROY_MI,SubType=The_XYZ,MeContext=ABCPNBULE02323269"


Each folder has around 10 to 15 files... with format "A*.bin.gz"


Thanks

Venkat



Don't have an account?
Coming from Hortonworks? Activate your account here