Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Data loss(Flow file content) during NIFI Restarts

avatar
New Contributor

My application is streaming data to NIFI continuosly. During that time If NIFI Restarts

then the data flow in progress between any processors lost it's content with below error.

Note: This is not related to processor, it happens for any processor.

Before Restart:

CDC_2-1723071196800.png

List queue->

CDC_3-1723071247488.png

View-> I can able to see my streaming record.

CDC_4-1723071306842.png

Now After doing NIFI Restart

List Queue ->

CDC_5-1723071592872.png

View or Download->

CDC_6-1723071631937.png

My flowfile atrributes are there and other details are available but the flowfile content is not there.

Kindly help me to solve this issue. All relevant idea's are welcome.

1 ACCEPTED SOLUTION

avatar
Master Collaborator

The details you see in UI other the actual content is loaded in memory and kept stored under flow file repository and content is in content repostoriru 

If I just take the example of flow file details, it has content that is located in Section 1 means Directory 1 under the content repo with an identifier number.

So the question is after every restart does your content repository location persist? 

 

 

View solution in original post

2 REPLIES 2

avatar
Master Collaborator

The details you see in UI other the actual content is loaded in memory and kept stored under flow file repository and content is in content repostoriru 

If I just take the example of flow file details, it has content that is located in Section 1 means Directory 1 under the content repo with an identifier number.

So the question is after every restart does your content repository location persist? 

 

 

avatar
New Contributor

Thanks kumar. Yeah we found that content repository file was not persistent in our container. After changing that , it works.