Can you post full error, logs, the sql, table structure. What version of Oracle? Can you post your full NiFi settings. is it with all data, perhaps some nulls causing an issue. what is the settings for the Avro reader?
... View more
What database is that for, that is very weird SQL syntax, why are you making it JSON to convert to int? Trying upping the precision from 10 to 14. Default Decimal Precision
... View more
I wonder if this was fixed 1.23.2. That seems like it shouldn't be too big, but it may be close. https://calcite.apache.org/docs/reference.html INTEGER, INT 4 byte signed integer Range is -2147483648 to 2147483647 try BIGINT
... View more
You need to look at CDC tools like Cloudera Kafka Connect with Debezium or Cloudera SQL Streaming Builder with Debezium. Kafka Connect https://docs.cloudera.com/runtime/7.2.17/kafka-connect/topics/kafka-connect-connector-debezium-oracle.html SSB https://docs.cloudera.com/csa/1.10.0/how-to-ssb/topics/csa-ssb-cdc-connectors.html Or you can do Oracle GoldenGate with Kafka. I have some examples in this article https://medium.com/cloudera-inc/cdc-not-cat-data-capture-e43713879c03
... View more
Under the cover this is just using Apache FTP Server Depends on passive ports https://mina.apache.org/ftpserver-project/configuration_passive_ports.html Send is over passive An example is here https://gist.github.com/tspannhw/43dbc81b1634a7acb61fada1a3c19a4e
... View more
https://medium.com/@tspann/ingesting-events-into-dockerized-ibm-db2-jdbc-with-apache-nifi-f0ca452d1351 It works fine with QueryDatabaseTableRecord and PutDatabaseRecord
... View more
Check with your IBM documentation as this is not standard character sets that non-mainframe platforms deal with. You need this converted to UTF-8 or other modern formats. JMS_IBM_Character_Set: IBM424 JMS_IBM_Encoding: 785 Check with IBM support. If you can convert to Unicode before extracting https://www.ibm.com/docs/en/ibm-mq/7.5?topic=conversion-jms-client-message-encoding You may need another driver https://www.ibm.com/support/pages/apar/IT18078
... View more
https://dev.to/tspannhw/simple-change-data-capture-cdc-with-sql-selects-via-apache-nifi-flank-19m4 You can use the metadata database processors to list all tables in a database and then read all values from tables
... View more
