I'm new using NIFI, I'm reading files and writting data into Oracle and SQL server databases. All was working as expected, but, suddenly, xthe process stopped writting/reading to/from databases. I processed around three million lines without issues, then I was not able to write anymore to databases. I had around two million files still enqueued on NIFI processor.
I restarted nifi nodes without success, I restarted zookeeper and nifi without success.
I found the next on logs:
2018-05-11 10:13:58,649 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:13:58,635 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:13:58,649; send took 14 millis
2018-05-11 10:14:03,701 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:14:03,690 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:14:03,701; send took 11 millis
2018-05-11 10:14:08,769 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:14:08,760 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:14:08,769; send took 8 millis
2018-05-11 10:14:12,174 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@43e07d88 checkpointed with 144120 Records and 28 Swap Files in 25663 milliseconds (Stop-the-world time = 144 milliseconds, Clear Edit Logs time = 43 millis), max Transaction ID 16506338
2018-05-11 10:14:12,175 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 144120 records in 25663 milliseconds
2018-05-11 10:14:13,808 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:14:13,803 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:14:13,808; send took 4 millis
2018-05-11 10:14:15,346 ERROR [StandardProcessScheduler Thread-1] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=01581180-466b-1b67-ae5a-ca7b587a09c6] QueryDatabaseTable[id=01581180-466b-1b67-ae5a-ca7b587a09c6] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
2018-05-11 10:14:15,349 ERROR [StandardProcessScheduler Thread-7] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_77]
at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[na:1.8.0_77]
at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) ~[na:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1150) [na:1.8.0_77]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_77]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77]
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.GeneratedMethodAccessor771.invoke(Unknown Source) ~[na:na]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_77]
at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_77]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1279) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1275) ~[na:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_77]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_77]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_77]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_77]
... 2 common frames omitted
Caused by: org.apache.nifi.processor.exception.ProcessException: Unable to communicate with database in order to determine column types
at org.apache.nifi.processors.standard.AbstractDatabaseFetchProcessor.setup(AbstractDatabaseFetchProcessor.java:199) ~[na:na]
at org.apache.nifi.processors.standard.QueryDatabaseTable.setup(QueryDatabaseTable.java:165) ~[na:na]
... 15 common frames omitted
Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist
