AWS Glue Data Catalog now supports Apache Iceberg table optimization in the US West (N. California) Region

AWS Glue Data Catalog

AWS Glue Data Catalog now supports automatic table optimization for Apache Iceberg tables in the US West (N. California) Region. Apache Iceberg is an open table format that delivers fast query performance over large tables in data lakes. With this launch, you can enable table optimization for individual tables or for all tables in your Data Catalog.

Table optimization continuously monitors your tables to compact small files in the background, remove snapshots that are past your retention settings, and delete unreferenced files that are no longer needed. You can monitor each run from the AWS Glue console, Amazon CloudWatch metrics, and logs.

What to do

• Enable table optimization using the AWS Glue console, AWS CLI, or AWS SDKs.
• Monitor optimization runs from the AWS Glue console, Amazon CloudWatch metrics, and logs.
• Visit the AWS Glue product page to get started.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.