1973
Posts
1225
Kudos Received
124
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
773 | 04-03-2024 06:39 AM | |
1424 | 01-12-2024 08:19 AM | |
771 | 12-07-2023 01:49 PM | |
1326 | 08-02-2023 07:30 AM | |
1920 | 03-29-2023 01:22 PM |
09-13-2023
05:48 AM
First backup your flows and settings. i don't think you can safely upgrade that many versions. Parameters, records, JSON format and so many other things have come. I would leave the old one running, backup all flows, run a new clean instance with JDK 11 or 17+ with NiFi 1.23.2 and see what is not working. https://www.datainmotion.dev/2020/06/no-more-spaghetti-flows.html See: https://community.cloudera.com/t5/Support-Questions/Nifi-Upgrade/m-p/346309#M234832
... View more
09-09-2023
09:39 AM
Can you upgrade to NiFi 1.23.2? If not, I would suggest opening a ticket with Cloudera. This maybe a bug. I would like to see full nifi logs though and which JDK you are. what language set? Did the source system change? https://support.oracle.com/knowledge/Oracle%20Cloud/2925617_1.html nothing in provenance, bulletins or nifi logs/? turn on debugging https://community.cloudera.com/t5/Community-Articles/NiFi-Debugging-Tutorial/ta-p/246082 perhaps a dump of the data, maybe some strange characters in there.
... View more
09-08-2023
04:25 AM
Could be sensitive column name? a typo somewhere.
... View more
09-08-2023
04:24 AM
Can you post full error, logs, the sql, table structure. What version of Oracle? Can you post your full NiFi settings. is it with all data, perhaps some nulls causing an issue. what is the settings for the Avro reader?
... View more
08-24-2023
07:22 AM
What database is that for, that is very weird SQL syntax, why are you making it JSON to convert to int? Trying upping the precision from 10 to 14. Default Decimal Precision
... View more
08-24-2023
06:41 AM
1 Kudo
I wonder if this was fixed 1.23.2. That seems like it shouldn't be too big, but it may be close. https://calcite.apache.org/docs/reference.html INTEGER, INT 4 byte signed integer Range is -2147483648 to 2147483647 try BIGINT
... View more
08-06-2023
06:07 PM
2 Kudos
You need to look at CDC tools like Cloudera Kafka Connect with Debezium or Cloudera SQL Streaming Builder with Debezium. Kafka Connect https://docs.cloudera.com/runtime/7.2.17/kafka-connect/topics/kafka-connect-connector-debezium-oracle.html SSB https://docs.cloudera.com/csa/1.10.0/how-to-ssb/topics/csa-ssb-cdc-connectors.html Or you can do Oracle GoldenGate with Kafka. I have some examples in this article https://medium.com/cloudera-inc/cdc-not-cat-data-capture-e43713879c03
... View more
08-02-2023
07:30 AM
1 Kudo
Under the cover this is just using Apache FTP Server Depends on passive ports https://mina.apache.org/ftpserver-project/configuration_passive_ports.html Send is over passive An example is here https://gist.github.com/tspannhw/43dbc81b1634a7acb61fada1a3c19a4e
... View more
07-12-2023
08:38 AM
Definitely upgrade to the latest NiFI which is 1.22.
... View more
06-29-2023
11:47 AM
https://medium.com/@tspann/ingesting-events-into-dockerized-ibm-db2-jdbc-with-apache-nifi-f0ca452d1351 It works fine with QueryDatabaseTableRecord and PutDatabaseRecord
... View more