Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

how to use listftp processor?

avatar
New Contributor

I want to monitoring directory in ftp server becuase files were sometimes changed and added.

I added ListFTP processer and then execute.

I want to get file list repeatly and diff filename and modification date however listftp was only one time execute. It wasn't execute again.

please advices me what to do.

1 ACCEPTED SOLUTION

avatar

Are you using DistributedMapCache along with ListSFTP?

Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.

View solution in original post

4 REPLIES 4

avatar
Guru

How was the ListSFTP processor scheduler set? See this doc for scheduling: https://docs.hortonworks.com/HDPDocuments/HDF1/HDF-1.2/bk_UserGuide/content/scheduling-tab.html

Suggestion is to have it every 5 sec or so.

Let me know how it goes.

avatar
New Contributor

9900-sc.png

I changed Run Schedule but it wasn't execute again.

what should I check?

avatar

Are you using DistributedMapCache along with ListSFTP?

Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.

avatar
New Contributor

I sloved the problem.

when new file added to ftp. it modification date is before listing.timestamp

Thanks you for helping me