Member since
11-08-2022
12
Posts
0
Kudos Received
0
Solutions
08-06-2023
06:07 PM
2 Kudos
You need to look at CDC tools like Cloudera Kafka Connect with Debezium or Cloudera SQL Streaming Builder with Debezium. Kafka Connect https://docs.cloudera.com/runtime/7.2.17/kafka-connect/topics/kafka-connect-connector-debezium-oracle.html SSB https://docs.cloudera.com/csa/1.10.0/how-to-ssb/topics/csa-ssb-cdc-connectors.html Or you can do Oracle GoldenGate with Kafka. I have some examples in this article https://medium.com/cloudera-inc/cdc-not-cat-data-capture-e43713879c03
... View more
07-27-2023
08:55 AM
what is the best practice for streaming data into Hive using nifi as the puthiveql is low performance .
... View more
Labels:
- Labels:
-
Apache NiFi
07-27-2023
07:42 AM
is this solution is fit in streaming more than puthive3ql for about 10 GB during the day???
... View more
04-10-2023
11:48 AM
i have nifi flow file contain avro format data which contain field ( k_entityId ) this filed either long or string data the output format is : is there is any dynamic way to enforce reading this column as string to be :
... View more
Labels:
- Labels:
-
Apache Airflow
03-13-2023
02:38 AM
can you maybe post the statement you are running in mongo + the result and afterwards the query you execute in NiFi and the entire error message you receive? Right now it seems to be an error regarding the format of the date/query. I am not that familiar with mongoDB but maybe in the meantime somebody with more experience will intervene.
... View more
03-10-2023
02:01 AM
any way to use query for filter only last minutes transactions
... View more
11-08-2022
10:26 AM
what about CDP ?
... View more