@stevenmatison Just a small correction to the description, The columns in my CSV will be adding up every year. No columns will be removed from my CSV If in this year I have 100 columns next year it will be 110, so every year 10 new columns will get added . Basically I have 10 columns with the suffix of year, repeated for different years Once I validate them using a schema I will be applying transformation on these columns to make 110 columns into 20 columns according to my database. Also I got what you are saying but I want to find a dynamic way to validate the CSV . If you can help me with some mock flow which is similar to my challenge it will be of great help(Also preferably I want to achieve without using custom processors or script)
... View more
