Automated Reasoning checks now include natural language test Q&A generation

AWS Release Notes

AWS announces the launch of natural language test Q&A generation for Automated Reasoning checks in Amazon Bedrock Guardrails. Automated Reasoning checks use formal verification techniques to validate the accuracy and policy compliance of outputs from generative AI models.

Automated Reasoning checks deliver up to 99% accuracy at detecting correct responses from LLMs, providing assurance in detecting AI hallucinations and assisting with ambiguity detection in model responses.

What to do

• Create and test Automated Reasoning policies using natural language documents and sample Q&As.
• Generate up to N test Q&As for each policy using content from the input document.
• Access the service through the Amazon Bedrock console or the Amazon Bedrock Python SDK.

Test generation for Automated Reasoning checks is available in the following regions: US (N. Virginia), US (Ohio), US (Oregon), Europe (Frankfurt), Europe (Ireland), and Europe (Paris).

To learn more, read the Amazon Bedrock documentation, review the tutorials on the AWS AI blog, and visit the Bedrock Guardrails webpage.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.