Support Questions
Find answers, ask questions, and share your expertise

Suddenly, I'm getting failed to invoke @OnScheduled method while querydatabasetable processor

New Contributor

I'm new using NIFI, I'm reading files and writting data into Oracle and SQL server databases. All was working as expected, but, suddenly, xthe process stopped writting/reading to/from databases. I processed around three million lines without issues, then I was not able to write anymore to databases. I had around two million files still enqueued on NIFI processor.

I restarted nifi nodes without success, I restarted zookeeper and nifi without success.

I found the next on logs:

2018-05-11 10:13:58,649 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:13:58,635 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:13:58,649; send took 14 millis 2018-05-11 10:14:03,701 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:14:03,690 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:14:03,701; send took 11 millis 2018-05-11 10:14:08,769 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:14:08,760 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:14:08,769; send took 8 millis 2018-05-11 10:14:12,174 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@43e07d88 checkpointed with 144120 Records and 28 Swap Files in 25663 milliseconds (Stop-the-world time = 144 milliseconds, Clear Edit Logs time = 43 millis), max Transaction ID 16506338 2018-05-11 10:14:12,175 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 144120 records in 25663 milliseconds 2018-05-11 10:14:13,808 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2018-05-11 10:14:13,803 and sent to nifi-qa1.myserver:9088 at 2018-05-11 10:14:13,808; send took 4 millis 2018-05-11 10:14:15,346 ERROR [StandardProcessScheduler Thread-1] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=01581180-466b-1b67-ae5a-ca7b587a09c6] QueryDatabaseTable[id=01581180-466b-1b67-ae5a-ca7b587a09c6] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. 2018-05-11 10:14:15,349 ERROR [StandardProcessScheduler Thread-7] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_77] at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[na:1.8.0_77] at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) ~[na:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1150) [na:1.8.0_77] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_77] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77] Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.GeneratedMethodAccessor771.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_77] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_77] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1279) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1275) ~[na:na] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_77] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_77] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_77] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_77] ... 2 common frames omitted Caused by: org.apache.nifi.processor.exception.ProcessException: Unable to communicate with database in order to determine column types at org.apache.nifi.processors.standard.AbstractDatabaseFetchProcessor.setup(AbstractDatabaseFetchProcessor.java:199) ~[na:na] at org.apache.nifi.processors.standard.QueryDatabaseTable.setup(QueryDatabaseTable.java:165) ~[na:na] ... 15 common frames omitted Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist

1 REPLY 1

Re: Suddenly, I'm getting failed to invoke @OnScheduled method while querydatabasetable processor

The error is showing that the table or view does not exist:

ProcessException: Unable to communicate with database in order to determine column types at Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist