27 lines
892 B
Markdown
27 lines
892 B
Markdown
# ollama
|
|
|
|
Local LLM + embedding runtime for the homelab. CPU-only deployment on
|
|
herbydev (no GPU). Reachable as `ollama:11434` from containers on the
|
|
shared `homelab` Docker network. Loopback `127.0.0.1:11434` on the host.
|
|
|
|
## Pulled models
|
|
|
|
| Model | Purpose | Pulled | Notes |
|
|
|-------|---------|--------|-------|
|
|
| `nomic-embed-text` | OB1 embedding model | 2026-05-14 | 768-dim, ~137MB; replaced OpenRouter `text-embedding-3-small` (1536-d) |
|
|
|
|
## Usage
|
|
|
|
```bash
|
|
docker compose -f compose.yml up -d
|
|
docker exec ollama ollama list # pulled models
|
|
docker exec ollama ollama pull <model> # add a model
|
|
curl -s http://127.0.0.1:11434/api/embeddings \
|
|
-d '{"model":"nomic-embed-text","prompt":"hello world"}' | jq '.embedding | length'
|
|
```
|
|
|
|
## Consumers
|
|
|
|
- **ob1-mcp** — embeddings + metadata extraction. Reaches Ollama as
|
|
`http://ollama:11434` via the `homelab` network.
|