question how to use listftp processor? in Archives of Support Questions (Read Only)

how to use listftp processor?

jojoman200 — Tue, 29 Nov 2016 18:20:20 GMT

I want to monitoring directory in ftp server becuase files were sometimes changed and added.

I added ListFTP processer and then execute.

I want to get file list repeatly and diff filename and modification date however listftp was only one time execute. It wasn't execute again.

please advices me what to do.

Re: how to use listftp processor?

gkeys — Tue, 29 Nov 2016 20:46:08 GMT

How was the ListSFTP processor scheduler set? See this doc for scheduling: https://docs.hortonworks.com/HDPDocuments/HDF1/HDF-1.2/bk_UserGuide/content/scheduling-tab.html

Suggestion is to have it every 5 sec or so.

Let me know how it goes.

Re: how to use listftp processor?

jojoman200 — Mon, 19 Aug 2019 09:59:47 GMT

I changed Run Schedule but it wasn't execute again.

what should I check?

Re: how to use listftp processor?

ninad_patkhedka — Wed, 30 Nov 2016 22:32:35 GMT

Are you using DistributedMapCache along with ListSFTP?

Same file won't be listed by ListSFTP and that may be reason to think it executed only once. If you just "touch" existing file then it is again listed. If there is continuous feed of different files then ListSFTP will list all new files coming into directory.

Re: how to use listftp processor?

jojoman200 — Thu, 01 Dec 2016 17:59:55 GMT

I sloved the problem.

when new file added to ftp. it modification date is before listing.timestamp

Thanks you for helping me