Amazon OpenSearch Serverless now supports Zstandard (zstd) codec for index compression

Amazon OpenSearch Serverless Updates

Amazon OpenSearch Serverless now supports Zstandard codecs for index storage, providing customers with more control over the balance between storage costs and query performance. With this update, customers can configure Zstandard compression to achieve up to a 32% reduction in index size compared to the default LZ4 codec, helping to lower managed storage costs for data-intensive workloads.

Customers running large-scale log analytics, observability pipelines, and time-series workloads on Amazon OpenSearch Serverless will benefit most from Zstandard compression, especially where high data volumes make storage efficiency a significant cost driver. The Zstandard compression algorithm is available in two modes in Amazon OpenSearch Serverless: zstd and zstd_no_dict. Customers can adjust the compression level to meet their specific needs: lower levels (e.g., level 1) offer meaningful storage savings with minimal impact on indexing throughput and query latency, while higher levels (e.g., level 6) maximize compression ratios at the cost of slower indexing speeds.

What to do

• Specify Zstandard codecs in your index settings at creation time.
• Adjust the compression level based on your workload needs.
• Review the Amazon OpenSearch Serverless documentation for more information.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.