Support Questions
Find answers, ask questions, and share your expertise

Kafka HDFS sink

Explorer

Hi,

 

I'm planning to use the provided Kafka service in HDP 2.6.5. 

 

My use case is to have multiple producers pushing events to Kafka topics and have the data pushed to HDFS as a sink.

 

Is this flow achievable using what's provided by HDP out of the box?  I was looking at Confluent, but it's way too complicated for my use case.

 

 

Thanks.

1 REPLY 1

Expert Contributor

I'm afraid that kafka doesn't come with HDFS sink connectorsor or something similar out of the box in HDP 2.6.5 , this is coming from CDP 7.1.1. I believe nifi or spark are alternatives that can be used for this.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.