Hi Team,
I am desperately looking for a helping hand here.
My flow will infuse/replicate data from different small databases into a single big database. I am using changecapturemysql processor to capture changes in small databases and putdatabase record to put into destination big database.
The table structure is same for all databases. but in order to differentiate in the big database there will be an additional column.
Example: (let me take only a simple and single table in all databases)
in sources, city_name is the PK. in destination, city_name and db_name both will form the PK.
DB1.city table
city_name
New york
Mumbai
DB2.city table
city_name
Paris
New york
Destination DB
city table
city_name db_name
New york. DB1
Mumbai DB1
Paris DB2
New york. DB2
I am able to capture the Inserts and Updates and put them in destination database. but when I delete a record in source, nothing is happening in the destination database. There is no error also.
How can I achieve that when i delete a record in any source DB, it needs to delete that particular record in destination DB. How to make nifi identify the record properly to delete. I also wonder how Nifi able to identify the record that need to be updated but not the record that need to be deleted. Please help.
