Support Questions

Find answers, ask questions, and share your expertise

Additional Hard Drive for Flowfile Repository

avatar
Explorer

I have a Nifi cluster on production and realized I need additional disk space for flowfile repository. What would be the best way to handle the scenario? If I mount a new disk from Ambari using the following configuration:

nifi.flowfile.repository.directory.flowfile2

would it be smart enough to load balance between existing drive and the new drive? Would it only apply to new incoming flowfiles?

1 ACCEPTED SOLUTION

avatar
Master Mentor
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

View solution in original post

1 REPLY 1

avatar
Master Mentor
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.