I am trying to read records from a SQL source and put them in a s3 bucket. Currently my flow is as follows: QueryDBTableRecord (SQL record to CSV) >>> ConvertRecord (CSV to JSON conversion) >>> JOLT (Rarrange the json to suit) >>> PutS3Oject (Duh) Firstly is this a valid route? It seems like there has been a lot of changes in the last few years and many tutorials are outdated and I think this is the current best practise. Secondly if this is correct, I'm struggling with the JOLT format. I want to transform this: into this: I've made a start with: And this moves the two items up to the upper level as desired but I am struggling to make pairs from the data points instead of getting a flat array.
... View more