James Washington
writing about archive utils free game ideas replays
Automation

llama-brain local model server

A small AI model that runs on my laptop for voice features.

built Oct 2026 Running a team of AI agents

how it works

Qwen3.5-4B GGUF on llama.cpp Metal via launchd.

Automation: Something that runs on a schedule by itself.

The code for this one lives in a private repo. This page explains the idea so you can build your own.

llama.cpplocal-llm

related

  • AI Workbench: local-first LLM interface Browser tool A chat workbench in one web page that talks to local or cloud AI models.
  • Put local inference on the idle laptop, not the server Technique Use the laptop's chip for free speech and small AI models so the home server stays responsive.
  • OpenClaw agent gateway (vault project page) Note Notes on an AI gateway that routes requests across several AI providers with automatic fallbacks.
  • Mac Mini homelab Document A home server that runs the household's smart-home, AI chat, monitoring and backup services.
  • Agent Scratchpad: a moderated GET-addressable commons for sandboxed LLM agents Note An idea for a public message board that locked-down AI agents could use to coordinate, built so the humans can always watch.
← everything I've built
© 2026 James Washington
github twitter rss