https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-create-S3-triggers-in-Apache-Nifi/m-p/172294#M42051 <P>Hi Obaid, please take a look at <A target="_blank" href="https://community.hortonworks.com/articles/49467/integrating-apache-nifi-with-aws-s3-and-sqs.html">https://community.hortonworks.com/articles/49467/integrating-apache-nifi-with-aws-s3-and-sqs.html</A></P><P>The missing piece in your description is SQS.</P> Wed, 28 Sep 2016 03:31:15 GMT andrewg 2016-09-28T03:31:15Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-create-S3-triggers-in-Apache-Nifi/m-p/172293#M42050 <P>Hi all,</P><P>I have a scenario where I want to trigger a signal for a flow to start processing whenever there is some data available on S3 to process. In such a scenario, all processors will be EventDriven (except for the trigger), and only run if there is any data to process (or somehow we trigger them to start processing).</P><P>Scenario:</P><P>- Whenever a file(or files) lands on S3, launch SQL queries (create table, copy data etc)</P><P>So, what would be a good way for defining such a trigger? </P><P>Thanks</P> Wed, 28 Sep 2016 03:28:08 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-create-S3-triggers-in-Apache-Nifi/m-p/172293#M42050 obaid_salikeen 2016-09-28T03:28:08Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-create-S3-triggers-in-Apache-Nifi/m-p/172294#M42051 <P>Hi Obaid, please take a look at <A target="_blank" href="https://community.hortonworks.com/articles/49467/integrating-apache-nifi-with-aws-s3-and-sqs.html">https://community.hortonworks.com/articles/49467/integrating-apache-nifi-with-aws-s3-and-sqs.html</A></P><P>The missing piece in your description is SQS.</P> Wed, 28 Sep 2016 03:31:15 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-create-S3-triggers-in-Apache-Nifi/m-p/172294#M42051 andrewg 2016-09-28T03:31:15Z