AWS Glue 6.0 delivers 30% price reduction and Iceberg v3 support

AWS Glue 6.0 Release
AWS Glue 6.0 is now available, featuring a 30% price reduction and full support for Apache Iceberg v3, Apache Hudi, and Delta Lake. It also includes runtime upgrades to Apache Spark 4.1, Python 3.13, and Scala 2.13.
New Features
- VARIANT data type with automatic shredding for faster reads on semi-structured data.
- Deletion vectors for high-performance row-level updates.
- Geometry and geography data types for spatial processing.
- Flexible schema evolution through UNKNOWN data type and DEFAULT column values.
- Spark Declarative Pipelines to eliminate repetitive orchestration code.
- Real-Time Mode streaming for sub-second latencies.
- Arrow-native Python UDFs for improved PySpark performance.
What to do
- Select Glue 6.0 from the version dropdown in the AWS Glue console or SageMaker Unified Studio when creating a new job.
- Migrate existing jobs using the Spark Upgrade Agent.
Source: AWS release notes
If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.



