Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

List HDFS missing 1 file

New Contributor

Hi,

I'm running ListHDFS on cron-driven basis to get all files from a certain day to zip them. The problem is, that always the file with the latest timestamp won't be picked up by the ListHDFS processor. 

I've found this topic with the same problem:
https://community.cloudera.com/t5/Support-Questions/Nifi-ListHDFS-missing-1-file-per-poll/td-p/18658...

https://issues.apache.org/jira/browse/NIFI-3213

 

If I got it right, it should be solved already, but it's not working for me. Any solution for this?

 

Using HDFS 3.1.1 and NiFi 1.9.0.3.4.1.1-4

1 REPLY 1

Super Guru

have you tried to upgrade?

 

is that latest file completed or in process.   Does it have read permissions?

 

Make sure you schedule your cron to after it is completed.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.