i am using flume to load log files to hdfs using a ftp agent. after loading the log files are being appended and ftp flume agent is transferring the whole log file again, not the appended data.
if to transfer only the appended data what should be the solution?
any other framework that can load the log files and the appended data as well?