Nifi Data Provenance does show events and keeps searching for Provenance events

nyakkanti — Wed, 15 Mar 2017 15:47:42 GMT

Hello,

Apache Nifi doesn't show data Provenance and show status as "Searching provenance events", checked logs it shows the following error.

Any suggestions to resolve the same.

2017-03-15 08:40:06,603 ERROR [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Failed to merge journals. Will try again. journalsToMerge: [./provenance_repository/journals/2642.journal.0, ./provenance_repository/journals/2642.journal.1, ./provenance_repository/journals/2642.journal.2, ./provenance_repository/journals/2642.journal.3, ./provenance_repository/journals/2642.journal.4, ./provenance_repository/journals/2642.journal.5, ./provenance_repository/journals/2642.journal.6, ./provenance_repository/journals/2642.journal.7, ./provenance_repository/journals/2642.journal.8, ./provenance_repository/journals/2642.journal.9, ./provenance_repository/journals/2642.journal.10, ./provenance_repository/journals/2642.journal.11, ./provenance_repository/journals/2642.journal.12, ./provenance_repository/journals/2642.journal.13, ./provenance_repository/journals/2642.journal.14, ./provenance_repository/journals/2642.journal.15], storageDir: ./provenance_repository, cause: java.lang.RuntimeException: java.io.FileNotFoundException: _1g.fdt

2017-03-15 08:40:06,607 ERROR [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository

java.lang.RuntimeException: java.io.FileNotFoundException: _1g.fdt

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:258) ~[na:na]

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:238) ~[na:na]

at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355) ~[na:1.8.0_101]

at java.util.TimSort.sort(TimSort.java:234) ~[na:1.8.0_101]

at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_101]

at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_101]

at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_101]

at org.apache.lucene.index.TieredMergePolicy.findMerges(TieredMergePolicy.java:292) ~[na:na]

at org.apache.lucene.index.IndexWriter.updatePendingMerges(IndexWriter.java:2020) ~[na:na]

at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1984) ~[na:na]

at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3029) ~[na:na]

at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3134) ~[na:na]

at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3101) ~[na:na]

at org.apache.nifi.provenance.lucene.SimpleIndexManager.returnIndexWriter(SimpleIndexManager.java:162) ~[na:na]

at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1864) ~[na:na]

at org.apache.nifi.provenance.PersistentProvenanceRepository$8.run(PersistentProvenanceRepository.java:1332) ~[na:na]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_101]

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_101]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_101]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_101]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_101]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_101]

at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]

Caused by: java.io.FileNotFoundException: _1g.fdt

at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:255) ~[na:na]

at org.apache.lucene.index.SegmentCommitInfo.sizeInBytes(SegmentCommitInfo.java:219) ~[na:na]

at org.apache.lucene.index.MergePolicy.size(MergePolicy.java:478) ~[na:na]

at org.apache.lucene.index.TieredMergePolicy$SegmentByteSizeDescending.compare(TieredMergePolicy.java:248) ~[na:na]

... 22 common frames omitted

Thanks,

Nagesh

Re: Nifi Data Provenance does show events and keeps searching for Provenance events

nyakkanti — Wed, 15 Mar 2017 23:04:26 GMT

Deleted the journal folder and restarted Nifi did solve the issue. Not sure what caused the issue in the first place.

question Nifi Data Provenance does show events and keeps searching for Provenance events in Archives of Support Questions (Read Only)

Nifi Data Provenance does show events and keeps searching for Provenance events

Re: Nifi Data Provenance does show events and keeps searching for Provenance events