Amazon MSK Express brokers now delivers Apache Kafka data to Amazon S3

Amazon MSK Express Brokers

Amazon MSK Express brokers now deliver data to Amazon S3 general purpose buckets, providing a fully managed capability to deliver Apache Kafka data in Amazon S3 for downstream processing. This capability automatically scales to deliver high-throughput Kafka data to S3 with end-to-end reliability for mission-critical workloads, while reducing ingestion and delivery costs by up to 60% compared to self-managed alternatives.

Customers can use this feature for log archival, compliance retention, Kafka replay, and training AI/ML models. MSK Express automatically handles scaling, retries, and backpressure, eliminating the need to manage connector fleets or coordinate across teams. It supports throughput of up to 10 GB/s for data delivery to Amazon S3 and manages routine operations such as capacity scaling and version upgrades without introducing delivery gaps.

What to do

• Add this delivery capability without provisioning additional broker egress throughput.
• Scale delivery to actual workload demand rather than provisioning for peak.
• Visit the pricing page for more information.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.