Member since
08-18-2019
56
Posts
11
Kudos Received
18
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
654 | 11-15-2023 05:38 AM | |
2377 | 07-12-2023 05:38 AM | |
710 | 01-10-2023 01:50 AM | |
995 | 12-06-2022 12:08 AM | |
3858 | 12-02-2022 12:55 AM |
10-06-2022
07:28 AM
Hello, you are absolutely correct that the more elegant solution for this would be the JoltTransfromJSON Processor. Here you can add or replace with a specification, your modified value to the content, which is in the attribute. If you don't have any experience with JOLT yet, feel free to post your content here including your requirement where the new value should be added.
... View more
09-26-2022
07:08 AM
Hello, you can configure that just 1 Flowfile will be handled inside of a specific ProcessorGroup. There is the config option on PG which is called: Process Group FlowFile Concurrency for that you can set the value: Single FlowFile per Node After PutKudu you will destroy the FlowFile or route it out from ProcessorGroup, then the next FlowFile will be released to enter to ProcessorGroup In your case the Flow would look like: ListFile Processor -> ProcessorGroup (handels fetchFile, data Transformation and putKudu)
... View more
01-19-2021
03:00 PM
Just asking, what is the result if you change the Property 'Destination' at AttributesToJSON to flowfile-content? 😉😄😄
... View more
01-13-2021
06:08 AM
You can use the "PutSQL" Processor to read your content of the sql output and it will be stored in your database. Or maybe instead of ConvertJsonToSQL, you can try it directly with "PutDatabaseRecord" Processor
... View more
01-13-2021
04:47 AM
Did you already think about to transform your csv to json and then rebuild it with JOLT?
... View more
01-13-2021
04:15 AM
To change the key names of your JSON you can transform it with JOLT. The Processor name calls JoltTransformJSON In the property you can "Jolt Specification" you can insert following code, that would be change your key from ServiceGroup to service_group and afterwards you can send the flowfile to the sql processor.. [
{
"operation": "shift",
"spec": {
"ServiceGroup": "service_group",
"*": "&"
}
}
]
... View more
01-08-2021
04:08 AM
1 Kudo
Hi, i tried a solution for you: 1) GenerateFlowFile Its your GetFile Processor to get the csv file 2) ConvertRecord Convert with CSVReader to JsonRecordSetWriter 3) SplitJson Split each bbject (csv row) with $.* as path 4) EvaluateJsonPath Add dynamicilly property with name filename and value $.ID to get the ID as filename on flowfile attribute 5) UpdateAttribute Add type of file to filename attribute value ${filename:append('.csv')} 6) ConvertRecord Now is the question how to work.. You can convert json back to csv or you are working with wait/notify, so that you can overhand your "filename" attribute to your splitted csv flowfile..
... View more
01-06-2021
12:47 PM
Hello, you could use following regex [^^]+ with that you should get the whole content. Please take a look at the property "Maximum Capture Group Length" at the ExtractText Processor, that its not too short.
... View more
01-03-2021
06:33 AM
Sorry, cant visualize it, but your flow can be look like this: QueryDatabaseTableRecord -> Wait ->PutS3Object
-> FetchFile -> EvaluateJsonPath -> Notify You can overhand the attribute from JSON to the waiting FlowFile. If you need help with configuration or other stuff for this, just text me.
... View more
12-04-2020
07:04 AM
try this "createdon" : {
"$date" : "putInHereDate"
} instead of "createdon": ISODate("2017-03-03") you can solve this also via JOLT
... View more