About RonMilne

RonMilne · ‎02-02-2022

If you use partition record (such as going from csv to json) and grouping by a column say /something the output contains the split in json - however, the provenance input and output claims are the same (it's the original data from the input in my case the csv contents)? Regards, Ron.

RonMilne · ‎02-02-2022

For the JoltTransformation what people will need to see is the data being fed to it in the context of the flow, i.e., the queue prior to the transform contains what? If it's an array then you're transform is wrong but seeing that will hopefully allow people to solve your issue. Regards, Ron.

RonMilne · ‎01-21-2022

Our sales team are extracting the months sales opportunities, actuals etc. Within the one CSV file there are potentially 100+ rows. Now, we need to create new flow files (array?) containing individual sales people. We have 20+ sales people each working on many opportunities. salesOpId,salesRepId, salesOpStage, ..... 142435,135235,inception .... 142436,572856,inception .... 142437,135235,pipelining .... 142435,572856,inception.... 149468,135235,contract.... 149464,135653,contract.... As you can see salesRepId 135235 is working against 3 opportunities, (142436,142437,149468) salesRepId 572856 is working against 2 opportunities (142436, 142435) salesRepId 135653 is working on a single opportunity (149464) For this example I need 3 FlowFiles created (which will be sent to their respective managers); I'm capable of reading the CSV changing it to Json; but now I'm completely stumped on the next step - split the json? Any help would be greatly appreciated. Ron M.

Online	Offline
Last Visited	‎05-26-2022 10:40 PM

Member Since	‎01-21-2022 08:25 PM
Last Visited	‎05-26-2022 10:40 PM
Posts	6
Kudos received	1

Cloudera Community

PartitionRecord Provenance Incorrect!

Re: Map JSON Key to Database Columns/Fields

Sales Data Split by Sales Rep?