Support Questions
Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

ListFile Processor fails to pick new csv files

Expert Contributor

I find that ListFile processor fails to pick new files for a particular feed. Indeed, that feed has a lot of small files and totals about 500k per day. When i delete the old processor and recreate, it starts working again. What could be the problem? BTW i use HDF 2.1.4...

Thank you


ListFile has a stored state. Stop the Processor, right click, then choose View State and you will see Clear State Link. Once ListFile gets a file it will not try to get that same file again. If your files are constantly changing, maybe FetchFile or TailFile will be better processors for your situation.