Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NIFI QueryDatabaseTable Maximum-value Columns gets ignored if in double quotes

Solved Go to solution
Highlighted

NIFI QueryDatabaseTable Maximum-value Columns gets ignored if in double quotes

New Contributor

Hi

I have issue with Maximum-value Column state on QueryDatabaseTable processor 1.6. I am using PostgreSQL database in which columns are in double quotes and if used in Maximum-value Column are ignored.

83463-screen-shot-2018-07-27-at-103510-priespiet.png

Screen shots looks like this and DEBUG mode shows attached.

83465-screen-shot-2018-07-27-at-103915-priespiet.png

State of the "locationId" is stored but not used in the SQL also attached.

With this configuration processor loads every time full load and ignores Maximum-value Column.

Do you know what could be the problem of this weird issue?

@Matt Burgess

83466-screen-shot-2018-07-27-at-104212-priespiet.png

1 ACCEPTED SOLUTION

Accepted Solutions

Re: NIFI QueryDatabaseTable Maximum-value Columns gets ignored if in double quotes

Super Guru

What version of NiFi are you using? I tried this on the latest snapshot (to become NiFi 1.8.0) and using double-quotes in the Maximum Value Column worked for me (i.e. it does incremental fetching). Looking at the code it seems like it should work in NiFi 1.7.x as well, I'm wondering if there was a bug in your version that we've since fixed.

3 REPLIES 3

Re: NIFI QueryDatabaseTable Maximum-value Columns gets ignored if in double quotes

Super Guru

The column name itself has double quotes?

Re: NIFI QueryDatabaseTable Maximum-value Columns gets ignored if in double quotes

Super Guru

What version of NiFi are you using? I tried this on the latest snapshot (to become NiFi 1.8.0) and using double-quotes in the Maximum Value Column worked for me (i.e. it does incremental fetching). Looking at the code it seems like it should work in NiFi 1.7.x as well, I'm wondering if there was a bug in your version that we've since fixed.

Re: NIFI QueryDatabaseTable Maximum-value Columns gets ignored if in double quotes

New Contributor

Hi Matt,

Thanks for feedback. Indeed seems there was the issue on version 1.6. I made a check on version 1.7.1 and everything works fine with double quotes.

Don't have an account?
Coming from Hortonworks? Activate your account here