About ganesh_sa20

ganesh_sa20 · ‎06-08-2018

Thanks @Matt Burgess

ganesh_sa20 · ‎05-30-2018

@Matt Burgess I have nifi job to capture cdc from MySQL DB.I am facing one issue with my nifi job in case of any failure. Suppose take an example if there is a failure while inserting record to DB using "PutSQL" processor in attached image because of issue in previous step "UpdateAttribute" processor.How to reprocessed failed records again to DB if I have resolved issue in "UpdateAttribute" processor?Is there any way to reprocessed records in sequence ? Let me give you details the problem I am facing is suppose my sql args for 12 was data type string but while converting it in "UpdateAttribute" I have given it to some other data type, so "PutSQL" will throw error and it will not insert record.Now suppose if I have changed "UpdateAttribute" with correct datatype then how I can reprocessed failed records using same job?

ganesh_sa20 · ‎04-28-2018

Hi @Matt Burgess I am beginner to Nifi and facing one issue with PutSQL. Scenario: I have two tables say TableA and TableB.In both table I have column 'date' but column sequence is not same.I am trying to apply format for 'date' column for TableA using ${sql.args.4.value:format("yyyy-MM-dd HH:mm:ss.SSS")} but as TableB has 4th column some text value not 'date' so it is failing for TableB. If I will try to use both ${sql.args.4.value:format("yyyy-MM-dd HH:mm:ss.SSS")} for TableA and ${sql.args.5.value:format("yyyy-MM-dd HH:mm:ss.SSS")} for TableB then it is not working as both tables has different column sequence for 'date'. Is there any way to handle this format dynamically by using column name? Thanks

Online	Offline
Last Visited	‎06-08-2018 12:43 PM

Member Since	‎04-28-2018 12:34 PM
Last Visited	‎06-08-2018 12:43 PM
Posts	8

Cloudera Community

Re: How to process failed records in CDC?

How to process failed records in CDC?

Re: Processor for replacing JSON values dynamicall...