Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Display the characteristics of csv file using Flume (spool directory as source)

Display the characteristics of csv file using Flume (spool directory as source)

Contributor

I am trying to display the characteristics of csv files (file name, MD5). I don't know how to do it, and is it possible. Any help please

1 REPLY 1

Re: Display the characteristics of csv file using Flume (spool directory as source)

Super Collaborator
For filename, you can use basenameHeader or fileHeader [1]. There isn't currently a header value that is populated for MD5 however, so you'd have to modify the spooldir source if you needed to pull the md5 value from the file.

-PD

[1] http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source