AI providers and cost

Choose a cloud or local model, keep token costs low, and use a stronger model only for planning.

Opsaido works with every major AI service and with local models. Your systems’ passwords and keys are encrypted and never sent to the AI.

Providers

TypeProvidersGood for
CloudAnthropic Claude, OpenAI, Azure OpenAI, Google Gemini, Amazon Bedrock, Mistral AI, xAI Grok, DeepSeekBest answers and planning
Fast / low-cost cloudGroq, Cerebras, OpenRouter, Together AI, Fireworks AI, DeepInfra, NVIDIA NIM, Hugging Face, Moonshot Kimi, Alibaba QwenCheap everyday questions
LocalOllama, LM Studio, vLLM, LocalAI, llama.cpp server, JanFully private, no token costs
Anything elseAny OpenAI-compatible endpointYour own gateway or proxy

Add one in Settings → AI providers → Add. Each preset fills in the address, and the model list loads live.

Cost settings

Every new provider starts with cost-saving defaults. Change them under Cost & response.

SettingDefaultWhat it does
Chat memory24,000 tokensHow much of the earlier conversation goes with each request. Lower is cheaper.
Max answer length6,000 tokensA cap on one reply. You pay only for what’s used.
Reasoning effortLowHow hard reasoning models think. Low suits most work; thinking is billed as output.
Planning model—A stronger model used only for dry runs and plans. Everyday questions stay on the cheaper one.
Temperature / Top PProvider defaultOnly for models that support them.

A good mix: a low-cost model for everyday questions, plus a stronger planning model for dry runs. You get careful plans without paying top prices for every “how’s the disk?”.

How Opsaido keeps requests small

WhatEffect
Only relevant tools are sent with each questionAbout two thirds fewer tokens per step
The tool list stays stable within a chatThe provider’s prompt cache keeps working (cached input costs a fraction)
Old tool output is shortened in chat memoryLong chats don’t grow without limit
Fleet tools check a whole cluster or many hosts in one callOne step instead of dozens

What each chat costs

Each chat’s Usage button shows what that conversation has used so far, for example 48.2k tokens · $0.06. It updates live during a run, and the tooltip breaks it down into input, output and cached tokens. The cost appears once you’ve set prices for the provider. To hide it for everyone, switch off Token meter in chat in Settings → AI providers.

Budgets

Set prices and a monthly budget for each provider. The live panel shows tokens and cost, and you get an alert at 80% and 100% of the budget.

Reply language

The assistant answers in the language each person writes in. To use one language for everyone, pick it in Settings → General → Reply language. Commands, code, file paths and names are never translated.