Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Nifi Data Provenance does show events and keeps searching for Provenance events

avatar
Expert Contributor

Hello,

Apache Nifi doesn't show data Provenance and show status as "Searching provenance events", checked logs it shows the following error.

Any suggestions to resolve the same.

2017-03-15 08:40:06,603 ERROR [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Failed to merge journals. Will try again. journalsToMerge: [./provenance_repository/journals/2642.journal.0, ./provenance_repository/journals/2642.journal.1, ./provenance_repository/journals/2642.journal.2, ./provenance_repository/journals/2642.journal.3, ./provenance_repository/journals/2642.journal.4, ./provenance_repository/journals/2642.journal.5, ./provenance_repository/journals/2642.journal.6, ./provenance_repository/journals/2642.journal.7, ./provenance_repository/journals/2642.journal.8, ./provenance_repository/journals/2642.journal.9, ./provenance_repository/journals/2642.journal.10, ./provenance_repository/journals/2642.journal.11, ./provenance_repository/journals/2642.journal.12, ./provenance_repository/journals/2642.journal.13, ./provenance_repository/journals/2642.journal.14, ./provenance_repository/journals/2642.journal.15], storageDir: ./provenance_repository, cause: java.lang.RuntimeException: java.io.FileNotFoundException: _1g.fdt

2017-03-15 08:40:06,607 ERROR [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository

java.lang.RuntimeException: java.io.FileNotFoundException: _1g.fdt

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:258) ~[na:na]

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:238) ~[na:na]

at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355) ~[na:1.8.0_101]

at java.util.TimSort.sort(TimSort.java:234) ~[na:1.8.0_101]

at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_101]

at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_101]

at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_101]

at org.apache.lucene.index.TieredMergePolicy.findMerges(TieredMergePolicy.java:292) ~[na:na]

at org.apache.lucene.index.IndexWriter.updatePendingMerges(IndexWriter.java:2020) ~[na:na]

at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1984) ~[na:na]

at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3029) ~[na:na]

at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3134) ~[na:na]

at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3101) ~[na:na]

at org.apache.nifi.provenance.lucene.SimpleIndexManager.returnIndexWriter(SimpleIndexManager.java:162) ~[na:na]

at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1864) ~[na:na]

at org.apache.nifi.provenance.PersistentProvenanceRepository$8.run(PersistentProvenanceRepository.java:1332) ~[na:na]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_101]

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_101]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_101]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_101]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_101]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_101]

at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]

Caused by: java.io.FileNotFoundException: _1g.fdt

at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:255) ~[na:na]

at org.apache.lucene.index.SegmentCommitInfo.sizeInBytes(SegmentCommitInfo.java:219) ~[na:na]

at org.apache.lucene.index.MergePolicy.size(MergePolicy.java:478) ~[na:na]

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:248) ~[na:na]

... 22 common frames omitted

Thanks,

Nagesh

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Deleted the journal folder and restarted Nifi did solve the issue. Not sure what caused the issue in the first place.

View solution in original post

1 REPLY 1

avatar
Expert Contributor

Deleted the journal folder and restarted Nifi did solve the issue. Not sure what caused the issue in the first place.