NIFI - Joining 2 flowfiles with SQL JOIN operation

[#1]

Hello everyone,

I have 2 flow files (tables in CSV format) and I need to merge them into one flow file, but to do that I need to perform a SQL JOIN operation because I only need data that exists in one table but not in the other.

Is there a way to do this in NIFI?

During the workflow I also convert the format to JSON and perform a SPLIT operation on the data, maybe it’s easier to get the result in need after these conversions.

Example for what I need:

Csv1:

1,a,NY

2,b,SF

3,w,SP

Csv2:

1,a,NY

3,w,SP

The result should be:

2,b,SF

Thank you!

[#2]

Put both tables in Kafka topics and have SQL Stream Builder joing them with a simple SQL Join.

or

https://community.cloudera.com/t5/Support-Questions/Nifi-how-to-sql-join-two-flowfiles/td-p/298227

http://apache-nifi-users-list.2361937.n4.nabble.com/Joining-two-or-more-flow-files-and-merging-the-c...

https://medium.com/@surajnagendra/merge-csv-files-apache-nifi-21ba44e1b719