Amazon Bedrock adds Amazon CloudWatch metrics for OpenAI- and Anthropic-compatible APIs

Amazon Bedrock Updates

Amazon Bedrock now supports monitoring inference traffic to the bedrock-mantle endpoint with Amazon CloudWatch metrics. This allows customers to monitor production inference, set up alarms, and plan capacity for their workloads.

New Features

• Monitor inference traffic to the bedrock-mantle endpoint with CloudWatch metrics.
• Support for the OpenAI Responses API, OpenAI Chat Completions API, and the Anthropic Messages API.

CloudWatch Metrics

• Namespace: AWS/BedrockMantle
• Metrics: Inference counts, input and output token totals, and client error counts.
• Granularity: Account, project, model, and project-and-model.

Availability

CloudWatch metrics for the bedrock-mantle endpoint are available in the following AWS Regions:

• US East (N. Virginia, Ohio)
• US West (Oregon)
• Asia Pacific (Jakarta, Mumbai, Sydney, Tokyo)
• Europe (Frankfurt, Ireland, London, Milan, Stockholm)
• South America (São Paulo)

What to do

• Open the Amazon CloudWatch console.
• Choose Metrics and select the AWS/BedrockMantle namespace.
• View metrics for your account and set up alarms as needed.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.