question Re: NiFi 2.x and "file-manager.sh" in Support Questions

NiFi 2.x and "file-manager.sh"

pbn — Wed, 29 Jan 2025 15:00:40 GMT

Hello Team,

We are planning to upgrade our use of NiFi from 1.x to 2.x, and we are looking very much forward to try the new version.

In NiFi 1.x we are using the "file-manager.sh" script in the toolkit for making backup and restore. It appears that this file is no longer present in NiFi 2.x.

1) Has this file been removed from NiFi 2.x permanently, or do you know of any plans for adding it to NiFi 2.x in a future release?

2) If the file is not coming to NiFi 2.x will there be any replacement file for making backup/restore, or should we collect files for backup ourselves such as flow.json.gz?

Best Regards

Re: NiFi 2.x and "file-manager.sh"

DianaTorres — Wed, 29 Jan 2025 20:31:29 GMT

@pbn Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @SAMSAL @MattWho who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: NiFi 2.x and "file-manager.sh"

MattWho — Thu, 30 Jan 2025 14:29:25 GMT

@pbn

Welcome to the Cloudera Community.

The Apache NiFi community made the decision to remove nifi-toolkit-admin in NIFI-11316 which included:

File Manager
Flow analyzer
Node manager
Notify

There are no plans to bring these back in NiFi 2.x.

NiFi deployments should protect the NiFi repositories from data loss through the use of RAID. Taking backups of the NiFi repositories (mainly flowfile, content, and provenance) makes little sense as the contents of these repositories continuously change. Backup of the config files in the NiFi conf directory and maintaining a copy of the flow.json.gz would allow you to recover a node. Keep in mind that the flow.json.gz is the same on all nodes in a NiFi cluster so it can be restored from any node to a new node.

Please help our community grow and thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt

Re: NiFi 2.x and "file-manager.sh"

pbn — Thu, 30 Jan 2025 14:47:07 GMT

Thank you