AI Gateway Configuration Patterns

Step-by-step patterns for configuring Azure API Management as an AI Gateway.

---

Pattern 1: Add AI Model Backend

Connect Azure OpenAI or AI Foundry models to your APIM instance.

Prerequisites

• APIM instance deployed (use azure-prepare skill to deploy APIM — see APIM deployment guide)
• Azure OpenAI or AI Foundry resource provisioned
• System-assigned or user-assigned managed identity enabled on APIM

Steps

1. Discover AI Resources

# Find Azure OpenAI resources
az cognitiveservices account list --query "[?kind=='OpenAI'].{name:name, rg:resourceGroup, endpoint:properties.endpoint}" -o table

# Find AI Foundry resources (if using)
az cognitiveservices account list --query "[?kind=='AIServices'].{name:name, rg:resourceGroup}" -o table

2. Enable Managed Identity on APIM

# Enable system-assigned identity