Amazon SageMaker HyperPod now supports custom AMIs (Amazon Machine Images) for Slurm clusters

Amazon SageMaker HyperPod Custom AMI Support

Amazon SageMaker HyperPod now supports custom AMIs for Slurm-orchestrated clusters, enabling customers to deploy clusters with pre-configured, security-hardened environments that meet their specific organizational requirements.

Customers deploying AI/ML workloads on HyperPod Slurm clusters can now build upon HyperPod's performance-optimized base AMIs while incorporating customized security agents, compliance tools, proprietary libraries, and specialized drivers directly into the image, delivering faster startup times, improved reliability, and enhanced security compliance.

What to do

• Specify custom AMIs when creating new HyperPod Slurm clusters using the CreateCluster API.
• Add instance groups with the UpdateCluster API.
• Patch existing clusters with the UpdateClusterSoftware API.

Custom AMIs must be built using HyperPod's public base AMIs to maintain compatibility with distributed training libraries and cluster management capabilities.

This feature is available in all AWS Regions where Amazon SageMaker HyperPod is supported.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.