Created 02-15-2017 04:56 PM
puthivestreaming.png I mean only metadata(attributes) without flow files with data.
My Example in puthivestreaming.png, after done processor PutHiveStreaming all flowfiles (with data) send to SelectHiveQL .
Created 02-15-2017 05:00 PM
The PutHiveStreaming processor has an attribute hivestreaming.record.count which may be helpful.
Created 02-16-2017 09:24 AM
Hello! Do you mean use processor ScanAttribute or LogAttribute for to delete superfluous data ? But into LogAttribute processor also send all data, example in LogAttribute.png .
Created 02-16-2017 02:13 PM
Don't worry about the data. It is not copied everywhere unless you need to change it. The data is actually a pass by reference. When a flow file is passed from one processor to another, the upstream processor passes a reference (to flowfile in content repository) to the second processor. Unless you need to modify the content, make a write etc, there isn't a data movement.
Created 02-16-2017 09:41 AM
Created 02-16-2017 02:47 PM
If you'd like to replace the content with a JSON object containing the attributes, you can use AttributesToJSON for that. If you'd just like to remove the content, you should be able to use ReplaceText with an empty replacement value or perhaps the expression ${literal('')}
Created 02-16-2017 03:58 PM
Hello!
Thanks you very match !