Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

interceptor in Flume cause kafka source not workingin HDP 2.6.4

interceptor in Flume cause kafka source not workingin HDP 2.6.4

Rising Star

I upgraded HDP from 2.6.1 to 2.6.4 today.

The problem I meet is, the flume reading kafka source seems not working in 2.6.4. The flume kafka source cannot read any data from the kafka brokers, and no channel data is stored in file channel.

I have checked the log of flumes, there is no any error log. Then I tried to remove interceptors of kafka source, the flume works again. So I believe it should be interceptors making kafka source not work. But it works in HDP 2.6.1

Here is the interceptor I use https://github.com/Schibsted-Tech-Polska/flume-json-interceptor

So how to solve this problem? Thanks