question Re: QueryDatabaseTable maximum value not increasing in Support Questions

QueryDatabaseTable maximum value not increasing

Romux — Fri, 28 Jun 2024 08:29:36 GMT

I upgraded from nifi-2.0.0-M1 to nifi-2.0.0-M3 on a new Server.

On my old Server the QueryDatabaseTable Job works fine, maximum value would be increased on every Job-Runtime as expected.

On the new Server maximum value is just increasing by 1. If my initial.maxvalue.hist_num is set to 114887000 i can see in State hist_num-value: 114887001

And every job-runtime it starts from 114887001. I tried so much different settings in QueryDatabaseTable but cant get it done, to work.

Maybe someone has an idea, how i can fix this. Would be very nice. Eventually logs where i can see error messages or something like that?

Thanks

Re: QueryDatabaseTable maximum value not increasing

Romux — Fri, 28 Jun 2024 11:29:01 GMT

I have now initial.maxvalue.hist_num set to 114890501
And i get this in the Log-File, it stays on 114890502

2024-06-28 13:27:04,199 DEBUG [Timer-Driven Process Thread-10] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=018f1000-d3e0-1837-2cdf-047e53cd7489] Driver connection reset to original setAutoCommit(true)
2024-06-28 13:27:04,199 DEBUG [Timer-Driven Process Thread-10] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=018f1000-d3e0-1837-2cdf-047e53cd7489] Returning CLUSTER State: StandardStateMap[version=Optional[24903], values={hist_main_bse@!@hist_num=114890502.00}]
2024-06-28 13:27:04,205 DEBUG [Timer-Driven Process Thread-10] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=018f1000-d3e0-1837-2cdf-047e53cd7489] Returning CLUSTER State: StandardStateMap[version=Optional[24903], values={hist_main_bse@!@hist_num=114890502.00}]
2024-06-28 13:27:04,205 DEBUG [Timer-Driven Process Thread-10] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=018f1000-d3e0-1837-2cdf-047e53cd7489] Setting CLUSTER State to {hist_main_bse@!@hist_num=114890502.00}
2024-06-28 13:27:04,214 INFO [Flow Service Tasks Thread-2] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@778257c8 // Another save pending = false
2024-06-28 13:27:06,251 DEBUG [NiFi Web Server-225] o.a.n.p.standard.QueryDatabaseTable QueryDatabaseTable[id=018f1000-d3e0-1837-2cdf-047e53cd7489] Returning LOCAL State: StandardStateMap[version=Optional[24904], values={hist_main_bse@!@hist_num=114890502.00}]

Re: QueryDatabaseTable maximum value not increasing

DianaTorres — Fri, 28 Jun 2024 17:15:31 GMT

@Romux Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @MattWho @mburgess who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: QueryDatabaseTable maximum value not increasing

Romux — Tue, 02 Jul 2024 12:16:11 GMT

I tried so much, to fix that Problem.

I also copied the whole nifi-2.0.0-M1 Folder to a new Computer but i have always the same Problem. Maximum Value is not increasing, just counting up bei 1.