Generative AI platforms & models
Amazon Bedrock Evaluations / Amazon Bedrock AgentCore vs Foundry observability & evaluations
Bedrock Evaluations and AgentCore Evaluations map to Foundry observability and evaluations (built-in and custom evaluators, continuous evaluation, and tracing).
Side-by-side comparison
| Aspect | Amazon Web Services | Microsoft Azure |
|---|---|---|
| Service | Amazon Bedrock Evaluations Amazon Bedrock AgentCore | Foundry observability & evaluations |
| Lifecycle | Generally available Generally available | Some dashboards are in preview. |
| What it is | Automatic, LLM-as-a-judge, and human evaluation jobs for models and RAG sources, including sources outside Bedrock. Modular agent platform. Harness (managed agent loop), Runtime, Memory, Gateway (MCP), Identity, Code Interpreter, Browser, Observability, Evaluations, Optimization, Policy, Registry, Payments. Works with any framework and any model. | Tracing, built-in and custom evaluators (quality, safety, agent metrics), continuous evaluation, and monitoring dashboards. Also includes Agent optimizer (preview). |
| Pricing model | You pay for the model inference used (generator and judge models) plus any human-evaluation task fees. AgentCore Evaluations is consumption-based. | Evaluations bill for the judge/model tokens consumed. Tracing data lands in Application Insights (Azure Monitor pricing). |
| Docs | Amazon Bedrock Evaluations docs Amazon Bedrock AgentCore docs | Foundry observability & evaluations docs |
| Pricing page | Amazon Bedrock Evaluations pricing Amazon Bedrock AgentCore pricing | Foundry observability & evaluations pricing |
| Exams | Generative AI Developer – Professional AIF-C01 | AI-103 AI-300 |
Key differences
- Bedrock Evaluations covers models (including Marketplace, custom, and imported models, and prompt routers) and RAG sources, including ones outside Bedrock. It supports human-worker evaluation jobs.
- AgentCore Evaluations and Optimization score agent sessions and traces (Strands, LangGraph, OpenTelemetry/OpenInference) and run A/B tests on prompt and tool-description changes.
- Foundry combines tracing, evaluators, and monitoring dashboards (some preview), and adds Agent optimizer (preview) to propose better instructions and tools.
Pricing summary
Pricing models only. No prices are quoted because they change by region and over time.
- AWS
- You pay for the model inference used (generator and judge models) plus any human-evaluation task fees. AgentCore Evaluations is consumption-based. Amazon Bedrock Evaluations pricing → Amazon Bedrock AgentCore pricing →
- Azure
- Evaluations bill for the judge/model tokens consumed. Tracing data lands in Application Insights (Azure Monitor pricing). Foundry observability & evaluations pricing →
Certification exam mapping
| Exam | Provider | Level | Status |
|---|---|---|---|
| AWS Certified Generative AI Developer – Professional | AWS | Professional | current Exam code not confirmed from the official page at build time; shown by name only. |
| AWS Certified AI Practitioner AIF-C01 | AWS | Foundational | current Italian and German versions retire after Oct 15, 2026 (per AWS cert page). |
| Microsoft Certified – Azure AI Apps and Agents Developer Associate AI-103 | Azure | Associate | current Generative AI and agentic solutions with Microsoft Foundry using Python. Successor in scope to the retired AI-102. |
| Microsoft Certified – Machine Learning Operations Engineer Associate AI-300 | Azure | Associate | current MLOps and GenAIOps infrastructure on Azure (IaC with Bicep/CLI, GitHub Actions). Closest successor in scope to the retired DP-100. |
Relevance is based on each exam's published scope, not a line-by-line objective match. Check the official study guide.
FAQ
What is the Azure equivalent of Amazon Bedrock Evaluations and Amazon Bedrock AgentCore?
Bedrock Evaluations and AgentCore Evaluations map to Foundry observability and evaluations (built-in and custom evaluators, continuous evaluation, and tracing).
How does pricing compare between Amazon Bedrock Evaluations and Amazon Bedrock AgentCore and Foundry observability & evaluations?
AWS: You pay for the model inference used (generator and judge models) plus any human-evaluation task fees. AgentCore Evaluations is consumption-based. Azure: Evaluations bill for the judge/model tokens consumed. Tracing data lands in Application Insights (Azure Monitor pricing). Check the official pricing pages for current rates.
Which certification exams cover this topic?
AWS Certified Generative AI Developer – Professional; AWS Certified AI Practitioner (AIF-C01); Microsoft Certified – Azure AI Apps and Agents Developer Associate (AI-103); Microsoft Certified – Machine Learning Operations Engineer Associate (AI-300).