@alim , I am using the captureChangeMySql processor to read the mysql binary-log file. This flow work fine for me when I configure the processor flow freshly but when I stop all the processor and start it gain then I am getting below error. Please suggest if you have any idea about the error issue.   2022-07-13 20:17:16,524 ERROR [Timer-Driven Process Thread-2] o.a.n.c.m.processors.CaptureChangeMySQL CaptureChangeMySQL[id=f5df756e-0181-1000-c210-1ab5c779f675] Processing failed org.apache.nifi.processor.exception.ProcessException: java.io.IOException: COMMIT event received while not processing a transaction (i.e. no corresponding BEGIN event). This could indicate that your binlog position is invalid.     at org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.onTrigger(CaptureChangeMySQL.java:721)     at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1283)     at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)     at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:103)     at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)     at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)     at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)     at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)     at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)     at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)     at java.base/java.lang.Thread.run(Thread.java:829) Caused by: java.io.IOException: COMMIT event received while not processing a transaction (i.e. no corresponding BEGIN event). This could indicate that your binlog position is invalid.     at org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.outputEvents(CaptureChangeMySQL.java:992)     at org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.onTrigger(CaptureChangeMySQL.java:705)     ... 10 common frames omitted 2022-07-13 20:17:16,740 INFO [blc-127.0.0.1:3306] c.g.shyiko.mysql.binlog.BinaryLogClient Connected to 127.0.0.1:3306 at mysql-bin.000025/12330 (sid:65535, cid:6) ... View more

Can anyone suggest how to fix above issue. This issue come when i stop the all processor and again start the all processor then I can see the error at CaptureChangeMySql processor level error.    2022-07-07 15:10:58,307 ERROR [Timer-Driven Process Thread-8] o.a.n.c.m.processors.CaptureChangeMySQL CaptureChangeMySQL[id=d7f0536f-0181-1000-db94-5950dddc0439] Processing failed org.apache.nifi.processor.exception.ProcessException: java.io.IOException: COMMIT event received while not processing a transaction (i.e. no corresponding BEGIN event). This could indicate that your binlog position is invalid. at  Note: This issue get resolved when i just delete the existing CaptureChangeMySQL processor and again create and configure the CaptureChangeMySQL processor.   ... View more

@araujo Can you please suggest how I can fix above issue.   CaptureChangeMySql processor is giving  value "{}" for BIT datatype. Processor out payload: { "type": "update", "timestamp": 1657194900000, "binlog_filename": "mysql-bin.000020", "binlog_position": 37029, "database": "nrpsubscriptiondb2306", "table_name": "user_subscription", "table_id": 137, "columns": [ { "id": 29, "name": "is_deleted", "column_type": -7, "last_value": "{}", "value": "{}" },  ] } ... View more

@araujo  I want to convert it to DateTime format like: 2021-10-17 15:58:58 not in timstamp. is there possible here to convert it to datetime formate like yyyy-MM-dd hh:mm:ss ? ... View more

I tried again below expressions: 1. $.{enrolled_at:replaceAll('(IST)\s',''):toDate('EEE MMM dd HH:mm:ss yyyy'):format('yyyy-MM-dd HH:mm:ss')} // got error {enrolled_at:replaceAll does not exist. 2. ${enrolled_at:replaceAll('(IST)\s',''):toDate('EEE MMM dd HH:mm:ss yyyy'):format('yyyy-MM-dd HH:mm:ss')} // expression validation failling ... View more

I tried above conversion but I am getting below error. AvroSchema: { "name": "enrolled_at", "type": { "type":"int", "logicalType":"date"} }, ErrorLog: org.apache.nifi.serialization.MalformedRecordException: Successfully parsed a JSON object from input but failed to convert into a Record object with the given schema at org.apache.nifi.json.AbstractJsonRowRecordReader.nextRecord(AbstractJsonRowRecordReader.java:162) at org.apache.nifi.serialization.RecordReader.nextRecord(RecordReader.java:50) at jdk.internal.reflect.GeneratedMethodAccessor653.invoke(Unknown Source) Caused by: com.jayway.jsonpath.InvalidPathException: Function with name: {literal does not exist.  ... View more