Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi: Use Nifi to Validate (count) number of Rows written in a file in HDFS

Nifi: Use Nifi to Validate (count) number of Rows written in a file in HDFS

New Contributor

I am quite new to using Nifi.

I have following scenario.

I have successfully ingested a CSV file to HDFS using Nifi putHDFS processor, and I can also validate the number of rows on HDFS command line using 'wc -l'. 

I want to validate the same (number of rows ingested) using some Nifi processor(s). As input I would like to use complete path where the CSV file is stored in HDFS which is available as flowfile attribute during using putHDFS the ingestion process. In other words I have the full path where the file is written in HDFS and I want to read the number of rows in that file using Nifi.

 

I appreciate your help.

Thanks.

Don't have an account?
Coming from Hortonworks? Activate your account here