Amazon MSK Express brokers now deliver data to streaming tables for Apache Iceberg

Amazon MSK Express Brokers

Amazon MSK Express brokers now deliver data to streaming tables for Apache Iceberg, a new capability that continuously materializes Apache Kafka topics as Apache Iceberg tables on Amazon S3 Tables. This reduces costs and query performance issues.

• Cost Reduction: Up to 60% lower cost for ingesting and delivering data into Amazon S3 Tables compared to self-managed deployments.
• Query Cost Reduction: Up to 30% lower downstream query costs compared to self-managed Apache Kafka deployments.
• Throughput: Supports up to 10 GB/s for delivery to Apache Iceberg on Amazon S3 Tables.
• Compatibility: Compatible with engines like Apache Spark, Trino, or Apache Flink.

What to do

• Enable the capability in the Amazon MSK console, MSK APIs, or MCP server.
• Query or transform data with your preferred engine.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.