AWS AppConfig launches managed experimentation tools for A/B testing

AWS AppConfig Experimentation Tools Now Generally Available

AWS has introduced experimentation tools in AWS AppConfig, allowing you to conduct A/B tests and feature experiments without needing separate infrastructure. These tools are based on over 25 years of Amazon's experimentation expertise and offer AI-driven guidance for robust experiments, exposure control, and locked treatment allocations for data-driven decisions.

You can run A/B tests and multivariate experiments across your application stack, from UI changes to AI model selections, using AWS AppConfig. Define feature variations, target audiences, and set traffic allocation percentages through the AWS Management Console, CLI, API, or AWS CDK. AI-assisted design validates your setup against Amazon's best practices, ensuring sufficient statistical power. Analyze results using Amazon CloudWatch or existing analytics tools, and promote the winning treatment to production through a standard AWS AppConfig safe rollout.

Experiments are supported on Amazon EC2, AWS Lambda, Amazon ECS, Amazon EKS, and on-premises servers via AWS AppConfig Agent.

What to do

• Set up and run experiments in AWS AppConfig
• Analyze results using Amazon CloudWatch or existing analytics tools
• Promote the winning treatment to production

AWS AppConfig experimentation is available in all AWS Regions, including the AWS GovCloud (US) Regions. Pricing is pay-as-you-go based on experimentation hours. To get started, visit the AWS AppConfig product page or learn about Experimentation in the AWS AppConfig User Guide.

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.