question Re: Making Data Available in Archives of Support Questions (Read Only)

Making Data Available

cristianvlean — Mon, 20 Feb 2017 20:44:39 GMT

Dear community,

I've been wondering something that cannot figure out yet. A quick summary I was able to work for a while with Flume to gather data from twitter and store it in a external table using Hive. After processing data using Hive, i finally got the results that i want. All steps made were manually. What i need now is to make same process, but automatically because i need to finally make it public. A suggestion?

Thanks for your help, Regards

Re: Making Data Available

gkeys — Mon, 20 Feb 2017 21:37:43 GMT

NiFi is a perfect technology for this: UI/configuration-based, easy connection to twitter stream, automated processing, enterprise security, SDLC and deploy automation ... NiFi usage is growing rapidly and starting to replace flume use cases.

Here are some links on NiFi in general:

Here are some How-to articles on NiFi Twitter and NiFi Hive:

Here is an article on NiFi SDLC and reusable components

https://community.hortonworks.com/articles/60868/enterprise-nifi-implementing-reusable-components-a.html

Re: Making Data Available

cristianvlean — Mon, 20 Feb 2017 22:06:40 GMT

Hi Greg,

Thank you very much for answering.

Regards