Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Kafka Tiered Storage

avatar
Explorer

Hello,

 

Is there any provision to write the Kafka data in to cloud. This feature is available in Apache and Confluent Kafka.

 

Thanks,

Uday

2 REPLIES 2

avatar
Expert Contributor

@Uday483 Thank you for posting your query. Are you referring to Writing the Kafka messages to the S3 buckets ? If so, you may use Kafka connect to publish the messages (using S3 sink) to write messages to the S3. Please let us know your requirement

Thanks,
Satz

avatar
Explorer

@satz , I am not referring to writing data using Kafka connect.

 

Kafka partition data should be written to cloud after spending certain amount of time on Disk.

https://docs.confluent.io/platform/current/kafka/tiered-storage.html

Thanks,

Uday