Amazon Web Services → Microsoft Azure
Azure equivalent of Amazon Bedrock Evaluations
Bedrock Evaluations and AgentCore Evaluations map to Foundry observability and evaluations (built-in and custom evaluators, continuous evaluation, and tracing).
About Amazon Bedrock Evaluations
| Provider | Amazon Web Services |
|---|---|
| Status | Generally available |
| What it is | Automatic, LLM-as-a-judge, and human evaluation jobs for models and RAG sources, including sources outside Bedrock. |
| Documentation | docs.aws.amazon.com |
| Pricing | Official pricing page |
Azure mappings (1)
| Capability | Azure equivalent | Match |
|---|---|---|
| Model, RAG & agent evaluation | Foundry observability & evaluations | Direct match |
Generative AI platforms & models(1)
Model, RAG & agent evaluation Direct match
Bedrock Evaluations and AgentCore Evaluations map to Foundry observability and evaluations (built-in and custom evaluators, continuous evaluation, and tracing).
- Bedrock Evaluations covers models (including Marketplace, custom, and imported models, and prompt routers) and RAG sources, including ones outside Bedrock. It supports human-worker evaluation jobs.
- AgentCore Evaluations and Optimization score agent sessions and traces (Strands, LangGraph, OpenTelemetry/OpenInference) and run A/B tests on prompt and tool-description changes.
- Foundry combines tracing, evaluators, and monitoring dashboards (some preview), and adds Agent optimizer (preview) to propose better instructions and tools.