Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Debugging NiFi Flows in Docker - problem with ListFile?

Highlighted

Debugging NiFi Flows in Docker - problem with ListFile?

Explorer

Hi there,


I'm running NiFi in docker. I'm trying to enable flow debugs and also to determine if NiFi can actually see in my data directory path. I'm trying to use a simple recursive list file processor to find the files based on a regular expression "^c.r".

I can docker exec into the container and can see that the nifi container can "see" into my filepath OK:

nifi@4f614c6c67c4:/data/sftp/cdr$ ls -1t | head -5 | egrep '^c.r'
cdr_AP2-HKG-CCP-UCM_12_201905281539_35251
cdr_AP2-HKG-CCP-UCM_06_201905281539_297892
cmr_AP2-HKG-CCP-UCM_06_201905281539_297892
cdr_AP9-SYD-UCCE-UCM_05_201905281539_200435
cdr_AP2-HKG-CCP-UCM_11_201905281539_98483

However, I can't get the ListFile processor to work and find those files. Any ideas on debugging strategies?

109061-screenshot-2019-05-28-at-164721.png

3 REPLIES 3
Highlighted

Re: Debugging NiFi Flows in Docker - problem with ListFile?

New Contributor

Check what user is the owner of nifi process and whether has privileges to read those files or not.

Highlighted

Re: Debugging NiFi Flows in Docker - problem with ListFile?

Explorer

I can see and read the files from inside the nifi container. Not sure why the nifi ListFile process isn't picking them up.


nifi@4f614c6c67c4:/data/sftp/cdr$ ls -1t | head -5 | egrep '^c.r'

cdr_AP9-SYD-UCCE-UCM_08_201905281913_183183

cdr_AP4-SYD-CCP-UCM_05_201905281913_53152

cdr_AP2-HKG-CCP-UCM_13_201905281912_89066

cdr_AP9-SYD-UCCE-UCM_07_201905281911_196358

cdr_AP8-HKG-UCCE-UCM_02_201905281910_243229

nifi@4f614c6c67c4:/data/sftp/cdr$ tail -n 5 cdr_AP9-SYD-UCCE-UCM_08_201905281913_183183

1,8,973062,138959080,1559070286,8,0,0,"","",0,0,4,0,0,0,0,0,0,0,0,0,0,"0","0",138959081,3,0,1054035722,"b003864986001","b003864986001","",0,0,4,0,0,0,0,0,0,0,

Re: Debugging NiFi Flows in Docker - problem with ListFile?

Explorer

I can find and read the files from inside the nifi docker container. Not sure why ListFile cannot:


nifi@4f614c6c67c4:/data/sftp/cdr$ ls -1t | head -5 | egrep '^c.r'

cdr_AP9-SYD-UCCE-UCM_08_201905281913_183183

cdr_AP4-SYD-CCP-UCM_05_201905281913_53152

cdr_AP2-HKG-CCP-UCM_13_201905281912_89066

cdr_AP9-SYD-UCCE-UCM_07_201905281911_196358

cdr_AP8-HKG-UCCE-UCM_02_201905281910_243229


nifi@4f614c6c67c4:/data/sftp/cdr$ tail -n 5 cdr_AP9-SYD-UCCE-UCM_08_201905281913_183183

1,8,973062,138959080,1559070286,8,0,0,"","",0,0,4,0,0,0,0,0,0,0,0,0,0,"0","0",138959081,3,0,1054035722,"b003864986001","b003864986001","",0,0,4,0,0,0,0,0,0,

Don't have an account?
Coming from Hortonworks? Activate your account here