Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Generate a summary from multiple flow files

Solved Go to solution
Highlighted

Generate a summary from multiple flow files

New Contributor

Hi,


I have 3 flows files(CSV) which are generating from ExecuteSQL -> ConvertRecord processor. Flow file 2 and 3 have single column let's say ID field and flow file 1 is a csv with 'n' columns. I want to create a one flow file which is a summary from the 3 flow files i.e, count of rows in flow files 1,2,3 which i can get it from executesql.row.count attribute and content of flow files 2 and 3 which is ID. Later i will send this flow file as an attachment via PutEmail processor. How can i achieve this?


Thanks&Regards,

P Vinay.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Generate a summary from multiple flow files

Super Guru

@vinay p

Try with CountText,CalculateRecordStats processors will gives what you are looking for.

To get one summary flowfile from 3 flowfiles then first you should merge 3 flowfilee into one by using MergeRecord/MergeContent processor then use CountText,CalculateRecordStats processors to get the summary of the flowfile.

Then use PutEmail processor to send to send the flowfile as an attachment.

1 REPLY 1

Re: Generate a summary from multiple flow files

Super Guru

@vinay p

Try with CountText,CalculateRecordStats processors will gives what you are looking for.

To get one summary flowfile from 3 flowfiles then first you should merge 3 flowfilee into one by using MergeRecord/MergeContent processor then use CountText,CalculateRecordStats processors to get the summary of the flowfile.

Then use PutEmail processor to send to send the flowfile as an attachment.

Don't have an account?
Coming from Hortonworks? Activate your account here