question Using Nifi to stream data from Free streaming(not twitter) api to hdfs in Archives of Support Questions (Read Only)

Using Nifi to stream data from Free streaming(not twitter) api to hdfs

bigspark — Tue, 21 Apr 2026 12:33:24 GMT

Actually iam trying to use any api so that i can stream data using nifi and put it to hdfs. I know GetHttp processor is used to fetch data from a website. I want to know any free api thats streams data and also which processor to use in Nifi to connect to that api and stream data from that api using nifi to hdfs. Its a prototype iam trying to build using nifi. I just want to use an api other than twitter. Appreciate any help from friends.

Re: Using Nifi to stream data from Free streaming(not twitter) api to hdfs

vzlatkin — Mon, 11 Jan 2016 07:04:30 GMT

This shows how to use Google Finance API: https://community.hortonworks.com/content/kbentry/8422/visualize-near-real-time-stock-price-changes-using.html

Re: Using Nifi to stream data from Free streaming(not twitter) api to hdfs

bigspark — Mon, 11 Jan 2016 17:23:53 GMT

Thanks Zlatkin

Re: Using Nifi to stream data from Free streaming(not twitter) api to hdfs

hellojuan — Mon, 11 Jan 2016 22:03:37 GMT

I am coming in a bit late but want to also recommend randomuser.me

Also want to point out that there are plenty of nifi templates found here: https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates

Look at the "Fun_with_Hbase" template which gets random data from a rest API and in your case use the PutHDFS processor to ingest in to HDFS.

Re: Using Nifi to stream data from Free streaming(not twitter) api to hdfs

bigspark — Tue, 12 Jan 2016 01:27:13 GMT

Thanks very much guys for the response. Iam planning to use datasift streaming api and rest api using nifi to store data in hdfs or hive or hbase tables? So i would appreciate your help in choosing the right approach and right nifi processors. Shall i go ahead and use GetHttp and PutHdfs here for both streaming and rest api or shall i think about streaming data directly from nifi to hbase or hive?? please let me know @Juan Sequeiros, @Vladimir Zlatkin thanks guys