Created 10-06-2018 12:24 AM
I have a Nifi cluster on production and realized I need additional disk space for flowfile repository. What would be the best way to handle the scenario? If I mount a new disk from Ambari using the following configuration:
nifi.flowfile.repository.directory.flowfile2
would it be smart enough to load balance between existing drive and the new drive? Would it only apply to new incoming flowfiles?
Created 10-08-2018 12:35 PM
NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).
-
It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.
-
You can move the existing FlowFile repository to a new disk.
1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi
-
Thank you,
Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.
Created 10-08-2018 12:35 PM
NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).
-
It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.
-
You can move the existing FlowFile repository to a new disk.
1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi
-
Thank you,
Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.