Data migration to Kafka from Oracle

[#1]

I have a data migration from Oracle to Kafka via GoldenGate. I need to identify the records coming in from Oracle say with a source_identifier like say AA ...which is not present as field in Oracle tab.

How can I get this value of source identifier in Kafka json file

eg we have gg.handler.hdfs.format.insertOpKey=I

Similary is there any config that can be set to , put tag souce_identifier as AA in kafka.

[#2 · Accepted solution]

You could use NiFi to read from the first, raw Kafka topic, enrich the messages with the appropriate values and perform other simple transformations, and then push to a second, final Kafka topic.