Skip to content
CTRL K
    Docs Standalone Kubernetes Tutorials Standalone Kubernetes Models Blog Enterprise Community Get Started GitHub
    ✨ agentgateway has joined the Agentic AI Foundation (AAIF) — Learn more ✨

    For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

    Page as Markdown
    Providers
    Learn how to configure agentgateway for a particular LLM.
    OpenAI-compatible providers

    Popular OpenAI-compatible providers include Mistral, DeepSeek, Groq, Together AI, Perplexity, and Fireworks AI.
    Amazon Bedrock
    Anthropic
    Azure OpenAI
    Gemini
    OpenAI
    OpenAI-compatible providers
    Vertex AI
    Ollama
    Configure agentgateway to route LLM traffic to Ollama for local model inference
    vLLM
    Configure agentgateway to route traffic to vLLM for self-hosted model inference
    Multiple endpoints
    Mock LLM with httpbun
    AboutModel aliasing
    Was this page helpful?
    

    
Agentgateway assistant
    


    Ask me anything about agentgateway configuration, features, or usage.
    Note: AI-generated content might contain errors; please verify and test all returned information.
    Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.
    Switching topics? Starting a new conversation improves accuracy.

    ↑↓ navigate
↵ select
esc dismiss
    

    

    What could be improved?
    Your feedback helps us improve assistant answers and identify docs gaps we should fix.
    Need more help? Join us on Discord:
https://discord.gg/y9efgEmppm
    Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here:
https://search.solo.io/.