Amazon Kinesis Data Streams now supports up to 50 enhanced fan-out consumers

Amazon Kinesis Data Streams Updates

Amazon Kinesis Data Streams now supports 50 enhanced fan-out consumers for On-demand Advantage streams. This update allows for more independent, low-latency, high-throughput consumers to be attached to the same stream, facilitating parallel analytics, ML pipelines, compliance workflows, and multi-team architectures without creating extra streams or causing throughput contention.

On-demand Advantage is an account-level setting that provides a different pricing structure for all on-demand streams in an AWS Region. It offers data usage with 60% lower pricing compared to On-demand Standard, with data ingest at $0.032/GB, data retrieval at $0.016/GB, and enhanced fan-out data retrieval at $0.016/GB. High fan-out workloads are most cost effective with On-demand Advantage.

What to do

• Enable On-demand Advantage for your account if you haven't already.
• Use the existing Kinesis API RegisterStreamConsumer to register new consumers to use enhanced fan-out up to the new 50 limit.
• Review the updated pricing and quotas in the Kinesis Data Streams documentation and the On-demand Advantage documentation.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.