Our Blog

Serverless Storage on Amazon EMR Serverless now supports terabyte-scale shuffle

Published
October 1, 2026
https://aws.amazon.com/about-aws/whats-new/2026/10/emr-serverless-terabyte-scale-shuffle/

Amazon EMR Serverless Updates

Amazon EMR Serverless now supports up to 1TB shuffle operations, raising the previous 200 GB per-job limit. This enhancement enables enterprise customers to run production-scale Apache Spark workloads that require processing large volumes of shuffle data during complex operations such as joins, aggregations, and sorting.

This feature is available with Amazon emr-7.14, emr-spark-8.1 and later, in 18 AWS Regions where Amazon EMR Serverless is available.

What to do

  • Migrate production workloads that process terabyte-scale datasets to Amazon EMR Serverless.
  • Utilize the new spill support for memory-intensive operations.
  • Check the Amazon EMR documentation for the full list of supported Regions and their applicable limits.

Source: AWS release notes




If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.

Follow our blog

Get the latest insights and advice on AWS services from our experts.

By clicking Sign Up you're confirming that you agree with our Terms and Conditions.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Related posts

Check out other insights from the team at West Loop Strategy.

View all
https://aws.amazon.com/about-aws/whats-new/2026/07/cognito-provisioned-limits

Amazon Cognito now supports self-service provisioned API rate limits

Amazon Cognito now allows you to increase or decrease your provisioned API rate limits on demand
Read more
https://aws.amazon.com/about-aws/whats-new/2026/04/amazon-cloudwatch-opentelemetry-metrics/

Amazon CloudWatch now supports OpenTelemetry metrics in public preview

Amazon CloudWatch now supports native OpenTelemetry (OTel) metrics in public preview, enabling you to send metrics directly using the OpenTelemetry Protocol (OTLP) without custom conversion logic or additional tooling
Read more
https://aws.amazon.com/about-aws/whats-new/2026/07/aws-console-home-cost-and-usage-eu-sovereign-cloud

AWS Console Home now supports the Cost and Usage widget in the AWS European Sovereign Cloud (Germany) Region

AWS Console Home now supports the Cost and Usage widget in the AWS European Sovereign Cloud (Germany) Region, allowing customers to surface insights from Cost Explorer and Cost Optimization Hub on their Console Home dashboard
Read more
View all