- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Additional Hard Drive for Flowfile Repository
- Labels:
-
Apache Ambari
-
Apache NiFi
Created ‎10-06-2018 12:24 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a Nifi cluster on production and realized I need additional disk space for flowfile repository. What would be the best way to handle the scenario? If I mount a new disk from Ambari using the following configuration:
nifi.flowfile.repository.directory.flowfile2
would it be smart enough to load balance between existing drive and the new drive? Would it only apply to new incoming flowfiles?
Created ‎10-08-2018 12:35 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).
-
It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.
-
You can move the existing FlowFile repository to a new disk.
1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi
-
Thank you,
Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.
Created ‎10-08-2018 12:35 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
NiFi does not support multiple FlowFile repositories. Only the Content and Provenance repositories support multiple locations (these are the only two repositories that may get very large).
-
It is highly recommended that the FlowFile repository is however located on its own separate disk or when that is not possible on its own separate logical volume.
-
You can move the existing FlowFile repository to a new disk.
1. Add a new disk to your NiFi server (or create a new logical volume)
2. Stop NiFi
3. Move entire contents from original flowfile_repository directory to new flowfile_repository location.
4. Verify proper ownership/permissions of all moved files
5. Edit nifi.properties so that "nifi.flowfile.repository.directory=" now points to new location.
6. Start NiFi
-
Thank you,
Matt
-
If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.
