question Re: Data loss(Flow file content) during NIFI Restarts in Support Questions

Data loss(Flow file content) during NIFI Restarts

CDC- — Wed, 07 Aug 2024 23:02:15 GMT

My application is streaming data to NIFI continuosly. During that time If NIFI Restarts

then the data flow in progress between any processors lost it's content with below error.

Note: This is not related to processor, it happens for any processor.

Before Restart:

List queue->

View-> I can able to see my streaming record.

Now After doing NIFI Restart

List Queue ->

View or Download->

My flowfile atrributes are there and other details are available but the flowfile content is not there.

Kindly help me to solve this issue. All relevant idea's are welcome.

Re: Data loss(Flow file content) during NIFI Restarts

ckumar — Mon, 12 Aug 2024 15:42:15 GMT

The details you see in UI other the actual content is loaded in memory and kept stored under flow file repository and content is in content repostoriru

If I just take the example of flow file details, it has content that is located in Section 1 means Directory 1 under the content repo with an identifier number.

So the question is after every restart does your content repository location persist?

Re: Data loss(Flow file content) during NIFI Restarts

CDC- — Wed, 14 Aug 2024 00:30:21 GMT

Thanks kumar. Yeah we found that content repository file was not persistent in our container. After changing that , it works.