Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Additional Hard Drive for Flowfile Repository

Solved Go to solution
Highlighted

Additional Hard Drive for Flowfile Repository

New Contributor

I have a Nifi cluster on production and realized I need additional disk space for flowfile repository. What would be the best way to handle the scenario? If I mount a new disk from Ambari using the following configuration:

nifi.flowfile.repository.directory.flowfile2

would it be smart enough to load balance between existing drive and the new drive? Would it only apply to new incoming flowfiles?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Additional Hard Drive for Flowfile Repository

Master Guru
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

1 REPLY 1

Re: Additional Hard Drive for Flowfile Repository

Master Guru
@Daniel Ahn

NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).

-

It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.

-

You can move the existing FlowFile repository to a new disk.

1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi

-

Thank you,

Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

Don't have an account?
Coming from Hortonworks? Activate your account here