Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

How to clear temp data from dataflow / nifi?

Super Collaborator

I noticed that the disk drive on my HDF server is almost full.

I did some exploring, and found that the nifi/content_repository folder has 1.4TB of data in it, even with nothing in any queue, and nifi stopped.

I have had nifi.flow.configuration.archive.enable=false in nifi/conf/nifi.properties (since I installed), but I see a whole folder full of data with today's date.

The data in the content_repository folder is thousands of folders, named numerically ("1", "2", etc). Each folder has a single file named with an epoch timestamp.

Can someone give me some guidance on what I can safely delete and how to keep this tool from eating up so much disk storage?

1 ACCEPTED SOLUTION

Super Collaborator

Ah! I see that there are 2 "archive" properties in the nifi.properties file:

nifi.flow.configuration.archive.enabled

nifi.content.repository.archive.enabled

I was setting the former, but I need to set the latter.

View solution in original post

1 REPLY 1

Super Collaborator

Ah! I see that there are 2 "archive" properties in the nifi.properties file:

nifi.flow.configuration.archive.enabled

nifi.content.repository.archive.enabled

I was setting the former, but I need to set the latter.