James Washington
writing about archive utils free game ideas replays
Automation

Jev shadow scorer for recruiter mail

Tests an AI scoring of recruiter emails quietly, logging results without letting it decide anything yet.

built Sep 2026 Agents that work while I sleep

how it works

Shadow mode: scores and logs only; backtest showed the hand rubric at AUC 0.514 and a refit at 0.87 on 5 positives, so no thresholds until labels justify them.

Automation: Something that runs on a schedule by itself.

The code for this one lives in a private repo. This page explains the idea so you can build your own.

classifierjob-huntshadow-mode

related

  • Job-mail feed agent Automation Every 5 minutes, sorts recruiter emails, pings the phone about the real ones, and files them on the board.
  • Run a classifier in shadow mode before it can gate Technique Let a new AI judge watch silently until there's evidence it's right.
  • Recruiter scan-and-reply (template-only) Automation Replies to new recruiter emails with a resume using fixed templates.
  • Profile A/B weekly inbound sweep Automation Measures weekly whether a profile rewrite changed the kind of recruiter mail coming in.
  • Job-hunt sourcer + hygiene agents Automation Small robots that file new recruiter leads, flag duplicate submissions, nudge stale threads and merge duplicate cards.
← everything I've built
© 2026 James Washington
github twitter rss