Skip to main content
Uday483
Silver ⭐️⭐️
April 6, 2023
Question

Kafka Tiered Storage

Hello,

 

Is there any provision to write the Kafka data in to cloud. This feature is available in Apache and Confluent Kafka.

 

Thanks,

Uday

2 replies

satz
Gold ⭐️
Gold ⭐️
April 7, 2023

@Uday483 Thank you for posting your query. Are you referring to Writing the Kafka messages to the S3 buckets ? If so, you may use Kafka connect to publish the messages (using S3 sink) to write messages to the S3. Please let us know your requirement

Translate
Thanks, Satz
Uday483
Uday483Author
Silver ⭐️⭐️
April 8, 2023

@satz , I am not referring to writing data using Kafka connect.

 

Kafka partition data should be written to cloud after spending certain amount of time on Disk.

https://docs.confluent.io/platform/current/kafka/tiered-storage.html

Thanks,

Uday

Translate