Amazon Bedrock Advanced Prompt Optimization now supports prompt shortening

Amazon Bedrock Advanced Prompt Optimization

Amazon Bedrock Advanced Prompt Optimization now supports prompt shortening, an optional setting that reduces the length of your prompt while maintaining or improving your evaluation scores. Optimized prompts were often longer than the original, but now you can reduce input token costs and time to first token.

What to do

• Enable prompt shortening for a prompt template in your input dataset.
• Create an optimization job as usual.
• Check the compression ratio and token counts in the output file and on the console results page.

Prompt shortening works with any evaluation method, including steering criteria, LLM-as-a-judge rubrics, and custom Lambda evaluators. It is available in all AWS Regions where Advanced Prompt Optimization is available.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.