James Washington
writing about archive utils free game ideas replays
Technique

Put local inference on the idle laptop, not the server

Use the laptop's chip for free speech and small AI models so the home server stays responsive.

Voice in, voice out

how it works

Kokoro TTS on MLX and a small Ollama model on the Air, reached over the tailnet with fallbacks when it sleeps; caffeinate LaunchAgent keeps it reachable on AC.

Technique: A pattern or hard-won lesson, written down so it isn't learned twice.

The code for this one lives in a private repo. This page explains the idea so you can build your own.

homelabmlxollamatechniquetts

related

  • Read every reply aloud (Kokoro TTS on the laptop) Agent hook Reads the AI's whole final answer out loud using a free voice model running on the laptop.
  • Mac Mini homelab Document A home server that runs the household's smart-home, AI chat, monitoring and backup services.
  • llama-brain local model server Automation A small AI model that runs on my laptop for voice features.
  • Continuity system: autopilot + context-budget relay Agent hook Keeps a long AI task moving without James typing 'yes go ahead' at every step, and passes the work to a fresh AI before the old one gets confused.
  • OpenClaw agent gateway (vault project page) Note Notes on an AI gateway that routes requests across several AI providers with automatic fallbacks.
← everything I've built
© 2026 James Washington
github twitter rss