Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Additional Hard Drive for Flowfile Repository

avatar
New Member

I have a Nifi cluster on production and realized I need additional disk space for flowfile repository. What would be the best way to handle the scenario? If I mount a new disk from Ambari using the following configuration:

nifi.flowfile.repository.directory.flowfile2

would it be smart enough to load balance between existing drive and the new drive? Would it only apply to new incoming flowfiles?

1 ACCEPTED SOLUTION

avatar
Master Mentor
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

View solution in original post

1 REPLY 1

avatar
Master Mentor
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.