.svg)
Amazon Redshift now supports Apache Iceberg v3 tables
Amazon Redshift Feature Update
Amazon Redshift now supports reading from and writing to Apache Iceberg v3 tables in your data lake. This update includes support for default column values, row lineage, and deletion vectors.
New Features
- Default Column Values: Define initial values for columns when no value is provided, simplifying schema evolution.
- Row Lineage: Track each row's identity and last-updated sequence number for incremental pipelines and CDC workflows.
- Deletion Vectors: Replace positional delete files with compact compressed bitmaps for faster reads and writes in high-frequency update and delete workloads.
What to do
- Create a v3 table using
CREATE TABLE... USING ICEBERG TABLE PROPERTIES ('format-version' = '3').
- Upgrade an existing v2 table with
ALTER TABLESET TABLE PROPERTIES ('format-version' = '3').
Source: AWS release notes
If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.
- Upgrade an existing v2 table with
