<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: merge too csv files in nifi in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/merge-too-csv-files-in-nifi/m-p/229267#M191124</link>
    <description>&lt;A rel="user" href="https://community.cloudera.com/users/84157/rajatpuchnanda15.html" nodeid="84157"&gt;@rajat puchnanda&lt;/A&gt;&lt;P&gt;Merge a group of flowfile (or) records is possible with MergeContent/MergeRecord processors.&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Example:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;if flowfile(ff1) having 123 records then ff2 having 345 by using mergecontent/record processors we can merge these flowfiles in to one like 123345.&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Merge &lt;/STRONG&gt;means combining the group of records/flowfiles(union all) ,if you want to remove duplicates(i.e 3 is duplicate record) from the combined record flowfile content then you can use QueryRecord Processor with row_number window function to eliminate duplicates.&lt;/P&gt;&lt;P&gt;This scenario is possible with NiFi without using lookup record processors.&lt;/P&gt;&lt;P&gt;But as you mentioned in one of the answer&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Scenario2:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;InputFile 1&lt;/P&gt;&lt;TABLE&gt;&lt;TBODY&gt;&lt;TR&gt;&lt;TD&gt;deptid&lt;/TD&gt;&lt;TD&gt;firstname&lt;/TD&gt;&lt;TD&gt;lastname&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;Aman&lt;/TD&gt;&lt;TD&gt;Sharma&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;Raman&lt;/TD&gt;&lt;TD&gt;Verma&lt;/TD&gt;&lt;/TR&gt;&lt;/TBODY&gt;&lt;/TABLE&gt;&lt;P&gt;InputFile 2&lt;/P&gt;&lt;TABLE&gt;&lt;TBODY&gt;&lt;TR&gt;&lt;TD&gt;deptid&lt;/TD&gt;&lt;TD&gt;salary&lt;/TD&gt;&lt;TD&gt;email&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;20000&lt;/TD&gt;&lt;TD&gt;&lt;A href="mailto:abc@gmail.com"&gt;abc@gmail.com&lt;/A&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;30000&lt;/TD&gt;&lt;TD&gt;&lt;A href="mailto:bgf@gmail.com"&gt;bgf@gmail.com&lt;/A&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;/TBODY&gt;&lt;/TABLE&gt;&lt;P&gt;OutputFile(By merging file1 and file2):-&lt;/P&gt;&lt;TABLE&gt;&lt;TBODY&gt;&lt;TR&gt;&lt;TD&gt;deptid&lt;/TD&gt;&lt;TD&gt;firstname&lt;/TD&gt;&lt;TD&gt;lastname&lt;/TD&gt;&lt;TD&gt;salary&lt;/TD&gt;&lt;TD&gt;email&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;Aman&lt;/TD&gt;&lt;TD&gt;Sharma&lt;/TD&gt;&lt;TD&gt;20000&lt;/TD&gt;&lt;TD&gt;&lt;A href="mailto:abc@gmail.com"&gt;abc@gmail.com&lt;/A&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;Raman&lt;/TD&gt;&lt;TD&gt;Verma&lt;/TD&gt;&lt;TD&gt;30000&lt;/TD&gt;&lt;TD&gt;&lt;A href="mailto:bgf@gmail.com"&gt;bgf@gmail.com&lt;/A&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;/TBODY&gt;&lt;/TABLE&gt;&lt;P&gt;This is not possible with MergeContent/Record but you can try with QueryRecord processor by implementing group and collect as set (or) some sort of sql logic in queryrecord processor to transpose the data into your desired format.This query Would be intensive if you are doing on larger number of records.&lt;/P&gt;</description>
    <pubDate>Thu, 14 Jun 2018 20:00:10 GMT</pubDate>
    <dc:creator>Shu_ashu</dc:creator>
    <dc:date>2018-06-14T20:00:10Z</dc:date>
  </channel>
</rss>

