Bring Your Local Models to the Agents You Love

Running language models locally has become more accessible and powerful. This allows for using coding agents with models running on your own hardware, keeping prompts and code local while avoiding per-token charges. However, configuring each agent to connect to a model server can be a bit complicated. The VibePod CLI simplifies this process by supporting providers. By saving the server's address and model, you can easily switch between providers like Ollama, Pi, Claude Code, and Codex.

To set up Ollama and VibePod, you need to install both and ensure Docker or Podman is running. You must configure Ollama with a larger context window, allow connections from your network, and restrict access with your firewall. Download a model that supports tool calls, such as Qwen3.8:27b or Gemma4:12b, and configure the VibePod environment variables if Ollama is already running. The context window determines how much text the model can work with at once, which is crucial for coding tasks.

After starting Ollama, you need to register the server as a provider in VibePod. This involves adding the server to VibePod with specific settings like the protocol, base URL, and authentication. You can then launch Pi with the chosen provider, which will use the default model. Testing the model on a small task is recommended to ensure it works well with the agent's tools.

It's also important to check the context window, API format, and match the provider's format to ensure smooth communication between the server and agent.