Support Questions
Find answers, ask questions, and share your expertise

Nifi: Use Nifi to Validate (count) number of Rows written in a file in HDFS

New Contributor

I am quite new to using Nifi.

I have following scenario.

I have successfully ingested a CSV file to HDFS using Nifi putHDFS processor, and I can also validate the number of rows on HDFS command line using 'wc -l'. 

I want to validate the same (number of rows ingested) using some Nifi processor(s). As input I would like to use complete path where the CSV file is stored in HDFS which is available as flowfile attribute during using putHDFS the ingestion process. In other words I have the full path where the file is written in HDFS and I want to read the number of rows in that file using Nifi.


I appreciate your help.