agntz
RuntimeHostedSelf-hostDocsChangelog
Sign inQuickstart
Documentation
View .mdOptimized for LLMs — paste directly into ChatGPT, Claude, or Cursor.

Models & providers

agntz calls model providers directly with your API key — there's no proxy and no data routing through our servers. You configure a provider by exporting its API key as an environment variable (embedded mode) or saving it in Settings → Connections (hosted / self-hosted).

Supported providers

ProviderEnv varProvider id
OpenAIOPENAI_API_KEYopenai
AnthropicANTHROPIC_API_KEYanthropic
GoogleGOOGLE_GENERATIVE_AI_API_KEYgoogle
OpenRouterOPENROUTER_API_KEYopenrouter
MistralMISTRAL_API_KEYmistral
xAIXAI_API_KEYxai
GroqGROQ_API_KEYgroq
DeepSeekDEEPSEEK_API_KEYdeepseek
PerplexityPERPLEXITY_API_KEYperplexity
CohereCOHERE_API_KEYcohere
Azure OpenAIAZURE_OPENAI_API_KEYazure

Picking a model in a manifest

model:
  provider: anthropic
  name: claude-sonnet-4-6
  temperature: 0

provider is the id from the table above; name is the exact model id the provider expects (e.g. gpt-5.4-mini, claude-sonnet-4-6, gemini-3-pro).

OpenRouter — one key, hundreds of models

OpenRouter is a meta-provider that proxies to virtually every commercial and open-source model behind a single API key. Use it when you want to:

  • Access open-source models (Llama, Mistral, DeepSeek, Qwen, …) without standing up your own inference.
  • Try many models without juggling per-provider API keys.
  • Take advantage of OpenRouter's routing, fallbacks, and unified billing.

Set the key and reference any OpenRouter model by its slug (<author>/<model>):

export OPENROUTER_API_KEY=sk-or-...
model:
  provider: openrouter
  name: anthropic/claude-sonnet-4
model:
  provider: openrouter
  name: meta-llama/llama-3.3-70b-instruct
model:
  provider: openrouter
  name: deepseek/deepseek-chat

Free-tier models are available via the :free suffix (subject to OpenRouter's rate limits):

model:
  provider: openrouter
  name: meta-llama/llama-3.3-70b-instruct:free

OpenRouter reports the per-request USD cost on every response, so traces in the UI show actual spend instead of an estimate.

Attribution

By default, requests through OpenRouter are attributed to your app with the headers HTTP-Referer: https://agntz.co and X-Title: agntz (used by OpenRouter's public rankings). Override via the provider's stored config:

{ "referer": "https://your-app.com", "title": "Your App" }

Other providers, custom endpoints

Every provider supports a baseUrl override in its stored config — useful for proxies and OpenAI-compatible gateways. For arbitrary providers not in the table above, supply a custom modelProvider implementation to createRunner.

← Previous
HTTP API reference
Next →
Compatibility matrix