Ollama in AGNT
One command to run open models on your own machine. Every AGNT workflow is provider-portable, so the same agents run here or anywhere else you point them.
Why teams pick it
Models
- Llama, Qwen, Mistral, Gemma locally
Strengths
- zero cloud dependency
- total data privacy
- free unlimited runs
In AGNT
Agents, workflows and tools use Ollama like any other provider — same nodes, same receipts, swap models per step if you want.
The shortest path to fully local AI
Ollama makes running open models locally a single command, and it is the reason "local-first AI" is a practical option rather than a research project. Paired with AGNT the whole stack becomes yours: the runtime, the credentials, the memory and the inference, with no external call in the loop at all.
What to watch
Model choice is bounded by hardware — VRAM decides what you can run, and quantisation trades quality for fitting in memory. Smaller models want simpler tool schemas and fewer options per call, so design the agent for the model you can actually run rather than the benchmark you read.
Using Ollama in a workflow
In practice you rarely commit a whole workflow to one model. A common arrangement puts Llama, Qwen, Mistral, Gemma locally on the steps where zero cloud dependency genuinely decides the outcome, and something cheaper and faster on the routine classification around it. Because AGNT normalises tool calling, that split is configuration per step rather than two separate builds.
Connect Ollama in two minutes
- Download AGNT Community Core — free, local-first, no account needed to run.
- Start Ollama on your machine, then pick it under Settings → Providers; AGNT finds the local endpoint.
- Give an agent a job — or install one from the marketplace — and watch the first receipt come back.
Ollama in AGNT — common questions
Is local inference genuinely free?
There are no per-token charges. You pay in hardware and electricity, which for high-volume routine work is frequently the better deal.
What hardware do I need?
Small quantised models run on a modern laptop; larger ones want a dedicated GPU with enough VRAM to hold the weights.
Does AGNT detect Ollama automatically?
Yes — start Ollama and select it under providers; AGNT finds the local endpoint.