Amazon CloudWatch Container Insights now supports Neuron UltraServers on Amazon EKS

Amazon CloudWatch Container Insights Update

Amazon CloudWatch Container Insights now supports Neuron UltraServers on Amazon EKS, providing enhanced observability for customers running large-scale, high-performance machine learning workloads on multi-instance nodes.

This new capability enables data scientists and ML engineers to efficiently monitor and troubleshoot their containerized ML applications, offering aggregated metrics and simplified management across Neuron UltraServer groups.

New Features

• Support for Neuron UltraServers on Amazon EKS
• New filter for UltraServers in EKS environments
• Aggregated metrics across all instances within an UltraServer
• Consolidated performance data for the entire UltraServer group

What to do

• Select an UltraServer ID to view new aggregate metrics
• Monitor consolidated performance data for ML workloads

Amazon CloudWatch Container Insights is available in all commercial AWS Regions, and the AWS GovCloud (US).

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.