Member since
02-10-2017
12
Posts
2
Kudos Received
0
Solutions
04-08-2017
07:24 PM
Hi ,
I have large data and using PUTSQL processor inserting into the database.
While inserting the data, i have observed some failures saying "IndexOutOfBoundException". The below is the exception. 2017-04-08 13:53:01,181 INFO [Provenance Maintenance Thread-3] o.a.n.p.PersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 9687527
2017-04-08 13:53:04,197 ERROR [Timer-Driven Process Thread-6] o.apache.nifi.processors.standard.PutSQL PutSQL[id=1272118f-17d0-1471-23dd-2e94d6a1f1f6] PutSQL[id=1272118f-17d0-1471-23dd-2e94d6a1f1f6] failed to process due to java.lang.IndexOutOfBoundsException: Index: 1, Size: 1; rolling back session: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
2017-04-08 13:53:04,197 ERROR [Timer-Driven Process Thread-6] o.apache.nifi.processors.standard.PutSQL
java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
at java.util.ArrayList.rangeCheck(ArrayList.java:653) ~[na:1.8.0_111]
at java.util.ArrayList.get(ArrayList.java:429) ~[na:1.8.0_111]
at org.apache.nifi.processors.standard.PutSQL.onTrigger(PutSQL.java:304) ~[nifi-standard-processors-1.1.0.jar:1.1.0]
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) ~[nifi-api-1.1.0.jar:1.1.0]
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1099) [nifi-framework-core-1.1.0.jar:1.1.0]
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136) [nifi-framework-core-1.1.0.jar:1.1.0]
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) [nifi-framework-core-1.1.0.jar:1.1.0]
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132) [nifi-framework-core-1.1.0.jar:1.1.0]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_111]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_111]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_111]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_111]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_111]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_111]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_111]
2017-04-08 13:53:04,207 ERROR [Timer-Driven Process Thread-6] o.apache.nifi.processors.standard.PutSQL PutSQL[id=1272118f-17d0-1471-23dd-2e94d6a1f1f6] PutSQL[id=1272118f-17d0-1471-23dd-2e94d6a1f1f6] failed to process session due to java.lang.IndexOutOfBoundsException: Index: 1, Size: 1: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1 Connected FAILED and RETRY queues from PUTSQL to PUTFILE to capture the query when its failed. But when PUTSQL failed, flowfile is not sendingto the queue by PUTSQL.
Please let us know how can i see the failed query in this scenario??
One more question:-
When i did Data Provenance on the PUTSQL processor, its not showing the current data and seems to be showing only 1000 entried.
Is there any way to see the full data for a particular processor?? Thanks Ravi
... View more
Labels:
- Labels:
-
Apache NiFi
04-03-2017
05:16 PM
I have created data flow which will transfer SQL server data from DB to DB in nifi and there a datetime column and it also contains some null value in source table, now i want to transfer that column with datetime value and also null values same time to the datetime column in target table. I'm unable to find right expression to put it in update attributes processor. I'm using below expression in update process: sql.args.1.name : CR_LINE_CMTD_START_DT sql.args.1.type : 93 sql.args.1.value :${CR_LINE_CMTD_START_DT:toDate("yyyy-MM-dd HH:mm:ss.SSS"):toNumber()} Please help to fix this Thanks sam , Hi
I have created data flow which will transfer SQL server data from DB to DB in nifi
and there a datetime column and it also contains some null value in source table, now i want to transfer that column with datetime value and also null values same time to the datetime column in target table.
I'm unable to find right expression to put it in update attributes processor.
I'm using below expression in update process: sql.args.1.name : CR_LINE_CMTD_START_DT sql.args.1.type : 93 sql.args.1.value :${CR_LINE_CMTD_START_DT:toDate("yyyy-MM-dd HH:mm:ss.SSS"):toNumber()}
Please help to fix this
Thanks sam
... View more
Labels:
- Labels:
-
Apache NiFi
03-02-2017
03:38 PM
Hi i have 5 separate queues for 5 different processors, everytime i'm going to each processor and clearing the each queue its taking me lot of time, is there any way to clear all the queue's at same time ? please help me with this thanks Ravi
... View more
02-21-2017
06:59 PM
Hi I tried putting attribute " ${my.date.string:format('yyyy-MM-dd')} " in update attribute got some error in PUTSQL, its not updating the value into database. please find the image of my dataflow in the attachment Thanks nifidatepng.png
... View more
02-21-2017
05:40 PM
can you please provide, what exactly needs to done( process) even I'm getting same issue problem with date, datetime, varbinary datatypes. please help me\ Thanks Ravi
... View more