- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Max file cout in PutFile processor does not work
- Labels:
-
Apache NiFi
Created ‎08-11-2016 02:32 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have putfile processor. Input directory "X:\ab\${path}" for recurse puting files and set max file count in input directory 10000, but it still writing there, not going to failed. Why? But when setting X:\ab\ whithout ${path} it works, but i need it. Any Ideas??
Created on ‎08-12-2016 03:09 PM - edited ‎08-18-2019 03:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Make sure you define the Auto terminate relationship properly and handled the exception in the PutFile processor. Make sure to route the failed message to failure queue.
You should able to see the following exception in the log.
2016-08-12 11:02:41,628 INFO [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.PutFile PutFile[id=4540b2c4-9425-4817-a7e1-d9d2930a2d5b] Penalizing StandardFlowFileRecord[uuid=51e1f6cb-3a31-42e3-bd65-1f6a1f20eff0,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1471013498033-1, container=default, section=1], offset=23989, length=806],offset=0,name=903851051716952,size=806] and routing to 'failure' because the output directory /Users/mpandit/test has 2 files, which exceeds the configured maximum number of files
Created on ‎08-12-2016 03:09 PM - edited ‎08-18-2019 03:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Make sure you define the Auto terminate relationship properly and handled the exception in the PutFile processor. Make sure to route the failed message to failure queue.
You should able to see the following exception in the log.
2016-08-12 11:02:41,628 INFO [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.PutFile PutFile[id=4540b2c4-9425-4817-a7e1-d9d2930a2d5b] Penalizing StandardFlowFileRecord[uuid=51e1f6cb-3a31-42e3-bd65-1f6a1f20eff0,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1471013498033-1, container=default, section=1], offset=23989, length=806],offset=0,name=903851051716952,size=806] and routing to 'failure' because the output directory /Users/mpandit/test has 2 files, which exceeds the configured maximum number of files
Created ‎08-16-2016 04:04 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, I did this, but my output directory is d:/abc/${path}
