Skip to main content
Uday483
Silver ⭐️⭐️
Apr 6, 2023 2:30 PM UTC
Question

Kafka Tiered Storage

Hello,

 

Is there any provision to write the Kafka data in to cloud. This feature is available in Apache and Confluent Kafka.

 

Thanks,

Uday

2 replies

satz
Gold ⭐️
Gold ⭐️
Apr 7, 2023 1:25 PM UTC

@Uday483 Thank you for posting your query. Are you referring to Writing the Kafka messages to the S3 buckets ? If so, you may use Kafka connect to publish the messages (using S3 sink) to write messages to the S3. Please let us know your requirement

Translate
Thanks, Satz
Uday483
Uday483Author
Silver ⭐️⭐️
Apr 8, 2023 4:29 AM UTC

@satz , I am not referring to writing data using Kafka connect.

 

Kafka partition data should be written to cloud after spending certain amount of time on Disk.

https://docs.confluent.io/platform/current/kafka/tiered-storage.html

Thanks,

Uday

Translate