Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Data process NIFI / KAFKA

Data process NIFI / KAFKA

Hello

I need recive csv file, process(compare any data with hive tables), put in quere priority and send csv again.

queue.jpg

Whats best pratice for this "problem"?

Thanks.

1 REPLY 1

Re: Data process NIFI / KAFKA

Super Collaborator

@Danilo Sousa using NiFi there are many different ways to get/fetch/send or receive a csv file. Using that data from that csv to query Hive is also possible, and sending the csv back into the same data flow is possible as well. These are all pretty basic concepts for a NiFi Data Flow. To start I would recommend inspecting the processors by dragging one into the working area, and typing keyword "get", "fetch", or "csv" and then inspecting the results to find best match to what you need to do. The same goes for "hive" or any "operation" you want to complete. The processor search box and descriptions are very detailed. Once you have a processor that works for your Use Case Scenario, double click it to have it added to the working area. Now right click that processor and inspect its Properties tab for details on how it is configured.

If you search the HCC deeper for "Nifi csv hive" you can find loads of specific examples:

https://community.hortonworks.com/search.html?f=&type=question+OR+repo+OR+supportkb+OR+kbentry+OR+id...

Here is one such example where @Matt Burgess goes into detail with the processors you need:

https://community.hortonworks.com/questions/80211/from-csv-to-hive-via-nifi.html

If this answer is helpful, please choose Accept to make the question as answered.

Don't have an account?
Coming from Hortonworks? Activate your account here