ollama

Local LLM + embedding runtime for the homelab. CPU-only deployment on herbydev (no GPU). Reachable as ollama:11434 from containers on the shared homelab Docker network. Loopback 127.0.0.1:11434 on the host.

Pulled models

Model	Purpose	Pulled	Notes
nomic-embed-text	OB1 embedding model	2026-05-14	768-dim, ~137MB; replaced OpenRouter text-embedding-3-small (1536-d)

Usage

docker compose -f compose.yml up -d
docker exec ollama ollama list             # pulled models
docker exec ollama ollama pull <model>     # add a model
curl -s http://127.0.0.1:11434/api/embeddings \
  -d '{"model":"nomic-embed-text","prompt":"hello world"}' | jq '.embedding | length'

Consumers

• ob1-mcp — embeddings + metadata extraction. Reaches Ollama as http://ollama:11434 via the homelab network.