We have scenario to read file feed containing different data schema for lines and then write to multiple tables. We are trying to setup error handling and consolidated all success and failure count for different types of data. our data flow is almost as follows,
getFile -> splitText -> RouteText -> ConvertToJson -> JsonToSql -> PutSql
Can you please help with some suggestion. Thanks in advance.