Support Questions
Find answers, ask questions, and share your expertise

Nifi Data Provenance does show events and keeps searching for Provenance events

Expert Contributor

Hello,

Apache Nifi doesn't show data Provenance and show status as "Searching provenance events", checked logs it shows the following error.

Any suggestions to resolve the same.

2017-03-15 08:40:06,603 ERROR [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Failed to merge journals. Will try again. journalsToMerge: [./provenance_repository/journals/2642.journal.0, ./provenance_repository/journals/2642.journal.1, ./provenance_repository/journals/2642.journal.2, ./provenance_repository/journals/2642.journal.3, ./provenance_repository/journals/2642.journal.4, ./provenance_repository/journals/2642.journal.5, ./provenance_repository/journals/2642.journal.6, ./provenance_repository/journals/2642.journal.7, ./provenance_repository/journals/2642.journal.8, ./provenance_repository/journals/2642.journal.9, ./provenance_repository/journals/2642.journal.10, ./provenance_repository/journals/2642.journal.11, ./provenance_repository/journals/2642.journal.12, ./provenance_repository/journals/2642.journal.13, ./provenance_repository/journals/2642.journal.14, ./provenance_repository/journals/2642.journal.15], storageDir: ./provenance_repository, cause: java.lang.RuntimeException: java.io.FileNotFoundException: _1g.fdt

2017-03-15 08:40:06,607 ERROR [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository

java.lang.RuntimeException: java.io.FileNotFoundException: _1g.fdt

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:258) ~[na:na]

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:238) ~[na:na]

at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355) ~[na:1.8.0_101]

at java.util.TimSort.sort(TimSort.java:234) ~[na:1.8.0_101]

at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_101]

at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_101]

at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_101]

at org.apache.lucene.index.TieredMergePolicy.findMerges(TieredMergePolicy.java:292) ~[na:na]

at org.apache.lucene.index.IndexWriter.updatePendingMerges(IndexWriter.java:2020) ~[na:na]

at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1984) ~[na:na]

at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3029) ~[na:na]

at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3134) ~[na:na]

at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3101) ~[na:na]

at org.apache.nifi.provenance.lucene.SimpleIndexManager.returnIndexWriter(SimpleIndexManager.java:162) ~[na:na]

at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1864) ~[na:na]

at org.apache.nifi.provenance.PersistentProvenanceRepository$8.run(PersistentProvenanceRepository.java:1332) ~[na:na]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_101]

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_101]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_101]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_101]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_101]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_101]

at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]

Caused by: java.io.FileNotFoundException: _1g.fdt

at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:255) ~[na:na]

at org.apache.lucene.index.SegmentCommitInfo.sizeInBytes(SegmentCommitInfo.java:219) ~[na:na]

at org.apache.lucene.index.MergePolicy.size(MergePolicy.java:478) ~[na:na]

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:248) ~[na:na]

... 22 common frames omitted

Thanks,

Nagesh

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Nifi Data Provenance does show events and keeps searching for Provenance events

Expert Contributor

Deleted the journal folder and restarted Nifi did solve the issue. Not sure what caused the issue in the first place.

View solution in original post

1 REPLY 1

Re: Nifi Data Provenance does show events and keeps searching for Provenance events

Expert Contributor

Deleted the journal folder and restarted Nifi did solve the issue. Not sure what caused the issue in the first place.

View solution in original post