I would like to use Flume (1.6.0) in order to poll a directory, target of an FTPS transfer, and read zip files in order to ingest the files in HDFS.
I am triyng use Spooling Directory Source but it seems it is written in order to exit with error if the file is lock.
The file is not written to the target directory in a unique solution, but it is appended.
Can you please confirm I can't use Spooling Directory Source for this use case?
... View more