- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to clear temp data from dataflow / nifi?
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
Created ‎01-19-2017 01:32 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I noticed that the disk drive on my HDF server is almost full.
I did some exploring, and found that the nifi/content_repository folder has 1.4TB of data in it, even with nothing in any queue, and nifi stopped.
I have had nifi.flow.configuration.archive.enable=false in nifi/conf/nifi.properties (since I installed), but I see a whole folder full of data with today's date.
The data in the content_repository folder is thousands of folders, named numerically ("1", "2", etc). Each folder has a single file named with an epoch timestamp.
Can someone give me some guidance on what I can safely delete and how to keep this tool from eating up so much disk storage?
Created ‎01-19-2017 01:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Ah! I see that there are 2 "archive" properties in the nifi.properties file:
nifi.flow.configuration.archive.enabled
nifi.content.repository.archive.enabled
I was setting the former, but I need to set the latter.
Created ‎01-19-2017 01:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Ah! I see that there are 2 "archive" properties in the nifi.properties file:
nifi.flow.configuration.archive.enabled
nifi.content.repository.archive.enabled
I was setting the former, but I need to set the latter.
