Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Kafka HDFS sink

avatar
Contributor

Hi,

 

I'm planning to use the provided Kafka service in HDP 2.6.5. 

 

My use case is to have multiple producers pushing events to Kafka topics and have the data pushed to HDFS as a sink.

 

Is this flow achievable using what's provided by HDP out of the box?  I was looking at Confluent, but it's way too complicated for my use case.

 

 

Thanks.

1 REPLY 1

avatar
Expert Contributor

I'm afraid that kafka doesn't come with HDFS sink connectorsor or something similar out of the box in HDP 2.6.5 , this is coming from CDP 7.1.1. I believe nifi or spark are alternatives that can be used for this.