Re: Serialize QueryDatabaseTable processors

carlos_camargo · ‎10-19-2018

Hi Matt, Thanks for reply and your advice. I updated the jdbc driver from ojdbc6 to ojdbc8 and now the Connection doesn't reset and work ok. I am going to continue checking the generateTableFetch maybe I can improve the query. thanks a lot for your help. Regards, Carlos

carlos_camargo · ‎10-17-2018

Hi Matt, Thanks for reply. I rec a video with a test to show you what I see you can see in this link: https://youtu.be/uS4Gay0U-e0 In addition next are the settings of the processors. Thanks in advance for you help. nifi-settings.pdf

carlos_camargo · ‎10-16-2018

HI, I'm using Nifi 1.7.1 and I have created eighteen QueryDatabaseTables to ingest data from and oracle 12C databases. If I run processors one by one all go well, however, If I start the process group, all the processors start and some work fine, but other generate the follow error: 2018-10-16 18:57:16,247 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=b55522c9-508c-3675-4476-d68bf07cb955] Unable to execute SQL select query SELECT * FROM MYTABLE due to java.sql.SQLRecoverableException: IO Error: Connection reset: java.sql.SQLRecoverableException: IO Error: Connection reset java.sql.SQLRecoverableException: IO Error: Connection reset I'm not be able to change the databases properties to permit more connections. So I would like to start the QueryDatabaseTables one behind other in sequence. is there any way to do this? I tryed to use a GenerateTableFetch followed by a ExecuteSQL. nothertheless, ExecuteSQL is quite slow. I will apreciate any ideas to resolve this use case.

Online	Offline
Last Visited	‎10-19-2018 04:12 PM

Date Registered	‎10-16-2018 06:04 PM
Last Visited	‎10-19-2018 04:12 PM
Total Messages Posted	3