Support Questions

Find answers, ask questions, and share your expertise

Data loss(Flow file content) during NIFI Restarts

avatar
New Contributor

My application is streaming data to NIFI continuosly. During that time If NIFI Restarts

then the data flow in progress between any processors lost it's content with below error.

Note: This is not related to processor, it happens for any processor.

Before Restart:

CDC_2-1723071196800.png

List queue->

CDC_3-1723071247488.png

View-> I can able to see my streaming record.

CDC_4-1723071306842.png

Now After doing NIFI Restart

List Queue ->

CDC_5-1723071592872.png

View or Download->

CDC_6-1723071631937.png

My flowfile atrributes are there and other details are available but the flowfile content is not there.

Kindly help me to solve this issue. All relevant idea's are welcome.

1 ACCEPTED SOLUTION

avatar
Master Collaborator

The details you see in UI other the actual content is loaded in memory and kept stored under flow file repository and content is in content repostoriru 

If I just take the example of flow file details, it has content that is located in Section 1 means Directory 1 under the content repo with an identifier number.

So the question is after every restart does your content repository location persist? 

 

 

View solution in original post

2 REPLIES 2

avatar
Master Collaborator

The details you see in UI other the actual content is loaded in memory and kept stored under flow file repository and content is in content repostoriru 

If I just take the example of flow file details, it has content that is located in Section 1 means Directory 1 under the content repo with an identifier number.

So the question is after every restart does your content repository location persist? 

 

 

avatar
New Contributor

Thanks kumar. Yeah we found that content repository file was not persistent in our container. After changing that , it works.