Amazon SageMaker AI now supports SOCI-indexed images to start training jobs in seconds

Amazon SageMaker AI Feature Update

Amazon SageMaker AI now supports Seekable OCI (SOCI)-indexed container images for training and processing jobs, reducing start times by up to 90%.

SOCI-indexed images enable faster container starts by streaming only necessary files initially, with the rest loaded in the background. This feature is available in all AWS Regions where SageMaker AI is offered.

What to do

• Reference a SOCI-indexed image from a private Amazon ECR repository in your training or processing job.
• Use a pre-indexed AWS Deep Learning Container by changing the image tag to its -soci variant.
• Add a SOCI index to your own image in Amazon ECR using open-source tools without rebuilding the image.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.