Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Additional Hard Drive for Flowfile Repository

avatar
New Contributor

I have a Nifi cluster on production and realized I need additional disk space for flowfile repository. What would be the best way to handle the scenario? If I mount a new disk from Ambari using the following configuration:

nifi.flowfile.repository.directory.flowfile2

would it be smart enough to load balance between existing drive and the new drive? Would it only apply to new incoming flowfiles?

1 ACCEPTED SOLUTION

avatar
Mentor
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

View solution in original post

1 REPLY 1

avatar
Mentor
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

Labels