Model Gateway

For AI agents: docs.octen.ai/capabilities/model-gateway.md

​

Why Model Gateway

• One key, frontier lineup. Claude, GPT, Gemini, and more. Switch models by changing one string.
• Built-in search. Enable the built-in search tools and the model grounds its answers on the live web; Octen runs the searches server-side, with no tool plumbing on your side.
• Drop-in compatibility. Speaks the OpenAI Chat Completions and Anthropic Messages protocols. Point your existing SDK at the Octen base URL.
• Image generation. Create or edit images with image models through the same gateway.

​

How It Works

1. Point your existing OpenAI or Anthropic SDK at the Octen base URL and pick a model.
2. Octen routes the request to the model provider; when built-in search tools are enabled, the model decides when to search and Octen executes the searches server-side.
3. The response comes back in the standard protocol shape, grounded in live web results when search was used.

​

Scenarios

​

Bring your existing code

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_OCTEN_API_KEY",
    base_url="https://api.octen.ai/v1",
)

response = client.chat.completions.create(
    model="openai/gpt-5.4",
    messages=[{"role": "user", "content": "Explain vector search in one paragraph"}],
)

import anthropic

client = anthropic.Anthropic(
    api_key="YOUR_OCTEN_API_KEY",
    base_url="https://api.octen.ai",
)

response = client.messages.create(
    model="anthropic/claude-sonnet-4.6",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Explain vector search in one paragraph"}],
)

​

Chat with a frontier model

curl -X POST https://api.octen.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "x-api-key: YOUR_API_KEY" \
  -d '{
    "model": "anthropic/claude-sonnet-4.6",
    "messages": [{ "role": "user", "content": "Explain vector search in one paragraph" }]
  }'

​

Answer with live web data

{
  "model": "openai/gpt-5.4",
  "messages": [{ "role": "user", "content": "What happened in tech today?" }],
  "tools": [{ "type": "octen_search" }]
}

​

Generate images

{
  "model": "openai/gpt-image-2",
  "prompt": "an isometric illustration of a search engine indexing the web"
}

​

Next Steps