Member since
11-22-2025
9
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 438 | 12-17-2025 07:13 PM | |
| 393 | 12-11-2025 03:06 PM |
12-17-2025
07:13 PM
Thanks Matt, thats a very useful explanation.
... View more
12-17-2025
07:10 PM
Hi I wanted to look into a need to transfer 1 TB files by using chunking in Nifi. Each file also has to have its 20 items of meta data associated with it remain intact so the metadata and the data both survive the breaking up of the file ( chunking ) into 1000 chunks and re-assembling the file at the destination ( de-chunking ). Also, is the meta data for the large file duplicated onto each of the file 1000 chunks or is it a sub-set of the meta data? Someone mentioned nifi passes the file chunks data through JVM memory on its way to the content repository. Can I confirm whether file chunks pass through JVM memory as they are written to the file/content repository for a large file ( or any file for that matter ?) - I was fairly sure they aren't, otherwise the JVM size ( limited by machine RAM ) on the machine would limit reading in of large file data, and that would limit large file transfer speed - is that correct? I'm trying to confirm my understanding of how Nifi handles these large files please. Any help appreciated.
... View more
Labels:
- Labels:
-
Apache NiFi
12-11-2025
03:06 PM
Hi Matt, What I discovered is that when running nifi on windows 10 ( and possibly linux as well?), any passwords that have special characters like + or \ etc need to be converted to ascii I think it is. so : / becomes %2F + becomes %2B Once i did this, it worked OK.
... View more
12-02-2025
07:27 AM
Hello @zzzz77, Did the answers help you here? If so, please consider marking the comment that help you as the solution.
... View more
12-02-2025
06:55 AM
@hckorkmaz01 While you are currently still using Apache NiFi 1.x major release version, it has reached end of life and is no longer receiving contributions. As such components will not get library updates or security fixes going forward. Apache NiFi 2.x is currently active major release being contributed to in the community. The PrometheusReportingTask was deprecated in Apache NiFi 1.x and officially removed in Apache NiFi 2.x major release. So I would avoid using it as you will eventually need to move to Apache NiFi 2.x to maintain a secure supported product release. But technically, this reporting task, while not well maintained in the community, is capable of creating a prometheus endpoint which exposes metrics for all components (includes connections) for consumption. That being said, Cloudera has taken steps to create Cloudera versions of many of the deprecated and removed components in Apache NiFi 2.x; as well as, introduced many components not available at all in any Apache release version (PrometheusReportingTask is not one of them that was retained). https://docs.cloudera.com/cfm/4.11.0/nifi-components-cfm/components/ NOTE: You are already using a considerably older Apache NiFI 1.18 release. Many bug fixes and CVEs security issues have been addressed since that release. If you cannot yet move to Apache NiFi 2.x, you should at least be on the most recent release of Apache NIFi 1.28. Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more