Step 1 - Auto-Setup Evaluation Suite
This step runs automatically after deployment. If the agent was deployed via the deploy skill,
.foundrycache and metadata may already be configured. Check.foundry/evaluators/,.foundry/datasets/, and the selected metadata file under the selected agent root before re-creating them.
Auto-Generate Suite
After deployment, immediately prepare a Foundry evaluation suite and local references for the selected environment without waiting for the user to request it.
1. Resolve Context
Use Common Project Context Resolution to compute effective context. In azd projects, prefer azd env get-values for deployment context and use the selected .foundry/agent-metadata*.yaml file only as an overlay/cache. Use agent_get, the local azure.yaml service block, and matching eval.yaml as needed to resolve:
| Value | Source |
|---|---|
projectEndpoint | azd env, then metadata override |
agentName / agentVersion | azd agent vars, then metadata/agent_get |