Using NiFi to collect tweets into one large file

[#1]

what's the best way to have a Twitter source feed into Nifi and land into one large file?

[#2 · Accepted solution]

@Timothy Spann

The best way to accomplish this is with the GetTwitter processor and the MergeContent processor. GetTwitter will connect up to a Twitter dev account and pull tweets (you can even filter them). Then you can use MergeContent to collect the tweets into manageable pieces based on number of records, size of file, or a timeout value.