Reply
Highlighted
Contributor
Posts: 34
Registered: ‎01-11-2016

Flume and md5 or sha from event body

Hi,

 

I use CDH 5.10 and I have set tiered Flume architecture with Kafka as message broker.

I wanted to set in flume headers md5 or sha diggest from event body. 
I saw that in earlier versions there was something like "Flume Sink Decorator Catalog" which had diges method:

digest("algorithm","attr", base64="boolean")

The digest decorator calculates a message digest of the event body and writes this value (as bytes) to the attr attribute. The valid algorithms are those valid for java.security.MessageDigest and includes MD5, SHA-1, SHA-256, SHA-384 and SHA-512. It can optionally base64 encode the digest value (defaults to false).

 

Now I in Flume 1.7 in CDH or in 1.8 I don't see any possibility to do this.

 

How can I put body digest into the Flume event?

 

Best Regards

 

Announcements