https://community.cloudera.com/t5/Archives-of-Support-Questions/Using-NiFi-to-collect-tweets-into-one-large-file/m-p/161292#M33266 <P>what's the best way to have a Twitter source feed into Nifi and land into one large file?</P> Tue, 28 Jun 2016 22:05:13 GMT TimothySpann 2016-06-28T22:05:13Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Using-NiFi-to-collect-tweets-into-one-large-file/m-p/161292#M33266 <P>what's the best way to have a Twitter source feed into Nifi and land into one large file?</P> Tue, 28 Jun 2016 22:05:13 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Using-NiFi-to-collect-tweets-into-one-large-file/m-p/161292#M33266 TimothySpann 2016-06-28T22:05:13Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Using-NiFi-to-collect-tweets-into-one-large-file/m-p/161293#M33267 <P><A rel="user" href="https://community.cloudera.com/users/9304/tspann.html" nodeid="9304">@Timothy Spann</A></P><P>The best way to accomplish this is with the GetTwitter processor and the MergeContent processor. GetTwitter will connect up to a Twitter dev account and pull tweets (you can even filter them). Then you can use MergeContent to collect the tweets into manageable pieces based on number of records, size of file, or a timeout value.</P> Tue, 28 Jun 2016 22:05:14 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Using-NiFi-to-collect-tweets-into-one-large-file/m-p/161293#M33267 emaxwell 2016-06-28T22:05:14Z