Data loss(Flow file content) during NIFI Restarts

Question

My application is streaming data to NIFI continuosly. During that time If NIFI Restarts

then the data flow in progress between any processors lost it's content with below error.

Note: This is not related to processor, it happens for any processor.

Before Restart:

List queue->

View-> I can able to see my streaming record.

Now After doing NIFI Restart

List Queue ->

View or Download->

My flowfile atrributes are there and other details are available but the flowfile content is not there.

Kindly help me to solve this issue. All relevant idea's are welcome.

ckumar · Accepted Answer

The details you see in UI other the actual content is loaded in memory and kept stored under flow file repository and content is in content repostoriru

If I just take the example of flow file details, it has content that is located in Section 1 means Directory 1 under the content repo with an identifier number.

So the question is after every restart does your content repository location persist?

CDC- · Answer

Thanks kumar. Yeah we found that content repository file was not persistent in our container. After changing that , it works.

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.