- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Kafka Tiered Storage
- Labels:
-
Apache Kafka
Created 04-06-2023 07:30 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
Is there any provision to write the Kafka data in to cloud. This feature is available in Apache and Confluent Kafka.
Thanks,
Uday
Created 04-07-2023 06:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Uday483 Thank you for posting your query. Are you referring to Writing the Kafka messages to the S3 buckets ? If so, you may use Kafka connect to publish the messages (using S3 sink) to write messages to the S3. Please let us know your requirement
Satz
Created 04-07-2023 09:29 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@satz , I am not referring to writing data using Kafka connect.
Kafka partition data should be written to cloud after spending certain amount of time on Disk.
https://docs.confluent.io/platform/current/kafka/tiered-storage.html
Thanks,
Uday
