07-09-2018 07:05 AM
I use CDH 5.10 and I have set tiered Flume architecture with Kafka as message broker.
I wanted to set in flume headers md5 or sha diggest from event body.
I saw that in earlier versions there was something like "Flume Sink Decorator Catalog" which had diges method:
The digest decorator calculates a message digest of the event body and writes this value (as bytes) to the attr attribute. The valid algorithms are those valid for java.security.MessageDigest and includes MD5, SHA-1, SHA-256, SHA-384 and SHA-512. It can optionally base64 encode the digest value (defaults to false).
Now I in Flume 1.7 in CDH or in 1.8 I don't see any possibility to do this.
How can I put body digest into the Flume event?