https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-use-Conflict-Resolution-Strategy-in-PutS3Object/m-p/160516#M57234 <P><A rel="user" href="https://community.cloudera.com/users/13532/thangamrajan8.html" nodeid="13532">@Thangarajan Pannerselvam</A> </P><P>If your GetFTP processor is configured with "delete original" set to false, every time this processor runs it will pull all th the files it finds including those pulled in the last run of the getFP processor.</P><P>The ListFTP processor maintains state unlike the GetFTP processor. so if you replace your GetFTP with both ListFTP and FetchFTP processors, you will not see the same files pulled twice unless the timestamp on the files on the FTP server are updated.</P><P>Thanks,</P><P>Matt</P> Thu, 16 Mar 2017 21:06:02 GMT MattWho 2017-03-16T21:06:02Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-use-Conflict-Resolution-Strategy-in-PutS3Object/m-p/160515#M57233 <P>Hi All,</P><P>In mynifi flow i have two processor one is GetFTP and PutS3Object . consider i have one file in FTP</P><P>a.txt .after the data get into the S3 the a.txt's timestamp is 12:00:00 in S3 after sometime again one file 'b.txt' is put into ftp now the S3 have two files as below but the timestamp in the S3 is changed for both a.txt and b.txt </P><P>a.txt 12:01:00</P><P>b.txt 12:01:00</P> Thu, 16 Mar 2017 20:54:25 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-use-Conflict-Resolution-Strategy-in-PutS3Object/m-p/160515#M57233 thangarajanp 2017-03-16T20:54:25Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-use-Conflict-Resolution-Strategy-in-PutS3Object/m-p/160516#M57234 <P><A rel="user" href="https://community.cloudera.com/users/13532/thangamrajan8.html" nodeid="13532">@Thangarajan Pannerselvam</A> </P><P>If your GetFTP processor is configured with "delete original" set to false, every time this processor runs it will pull all th the files it finds including those pulled in the last run of the getFP processor.</P><P>The ListFTP processor maintains state unlike the GetFTP processor. so if you replace your GetFTP with both ListFTP and FetchFTP processors, you will not see the same files pulled twice unless the timestamp on the files on the FTP server are updated.</P><P>Thanks,</P><P>Matt</P> Thu, 16 Mar 2017 21:06:02 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-use-Conflict-Resolution-Strategy-in-PutS3Object/m-p/160516#M57234 MattWho 2017-03-16T21:06:02Z