Amazon SageMaker HyperPod now supports flexible instance groups

Amazon SageMaker HyperPod Flexible Instance Groups

Amazon SageMaker HyperPod now supports flexible instance groups, allowing customers to specify multiple instance types and subnets within a single instance group. This feature addresses operational overhead by eliminating the need to manage separate instance groups for each instance type and availability zone combination.

What to do

• Use the new InstanceRequirements parameter to define an ordered list of instance types.
• Provide multiple subnets across availability zones in a single instance group.
• Create flexible instance groups using the CreateCluster and UpdateCluster APIs, the AWS CLI, or the AWS Management Console.

Flexible instance groups are available for SageMaker HyperPod clusters using the EKS orchestrator in all AWS Regions where SageMaker HyperPod is supported.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.