Mycroft Ep. 3: The Boring (and Essential) Work of Code Auditing
Amruta Naik spends week three of Mycroft not writing code, but proving a vendor runway calculator doesn't already exist in a 100-recipe repository.
Most builders want to start typing the moment an idea feels ready. Amruta Naik's third week on the Mycroft project is a deliberate exercise in not doing that. Instead of writing new scoring code, she spent the week checking whether the thing she wanted to build already existed somewhere in the repository, and writing down honestly what state her own work was actually in.
The trap of building before checking
The problem Amruta describes is one every builder eventually falls into: excitement to build outruns the discipline to check whether someone already built it. In a repository holding 100 recipes, there is a real chance an idea already exists in some form. Skip the check and the best case is duplicated work; the worst case is shipping a second, slightly worse version of something the team already trusts. The fix isn't clever, just disciplined: before writing another line of scoring code, search the whole library first.
Confirming a real gap, in writing
Amruta searched the entire hundred-recipe library for anything doing runway or financial health work and wrote down an actual verdict rather than a hunch. Her finding: no recipe in the library computes vendor runway as a standalone, sourced, gated artifact. The closest match mentions runway in passing inside a larger multi-agent brief, but never actually computes it. That gap is now documented, not assumed, which is the entire point of doing the search in the first place.
Writing an honest recipe spec
With the gap confirmed, Amruta wrote the formal recipe specification, the machine-readable header sitting at the top of the recipe that states what it is and, crucially, what state it's in. She set the status to draft, with each open field acting as a placeholder for work not yet done. The header functions as a promise: the label always has to tell the truth about how mature the recipe actually is, never how mature anyone wishes it were.
Earning your way up the maturity ladder
That honesty principle extends into a maturity ladder every recipe climbs: draft, specified, runnable, sample, and up. A recipe doesn't move a rung because someone feels ready to promote it. It moves because there's evidence in the run log to justify the promotion. This week's recipe earned its first honest label, and every future rung it climbs will need to be earned the same way, with logged evidence rather than a status change made on faith.
Key takeaways
- Search the full repository and write down an actual verdict before building anything new, rather than assuming a gap exists.
- A machine-readable status header (draft, specified, runnable, sample, and so on) keeps a recipe's stated maturity honest.
- Recipes only move up the maturity ladder when run log evidence justifies the promotion, never just because it feels time.
- The unglamorous auditing week is what makes the more visible, "glamorous" weeks of a project trustworthy.
Try it yourself
Before starting your next feature or project, spend twenty minutes doing what Amruta did: search whatever repository or system you're adding to and confirm, in writing, whether your idea already exists. Then write one honest sentence about what state your own work is really in, not the state you wish it were. That habit is central to how the Mycroft project, part of Humanitarians AI's fellow-driven work, builds tools people can actually trust.
Chapters
Full transcript(auto-generated, with timestamps)
Intro: Amruta on the importance of checking if your code already exists
[0:00]Hello, Amuda. This week, I wrote almost no new scoring code. Instead, I did the least glamorous, most important thing in any project. I checked whether the thing I'm building already exists, and I wrote down honestly what state it's in. Boring, maybe, but skipping this is how people waste a month rebuilding something that was already there. This is week three. The problem is a trap every builder falls into. You're so excited to build that you never ask whether someone already built it. In a 100 recipe repository, there's a real chance your idea exists in some form. If you skip the check, best case, you duplicate work. Worst case, you ship a second, slightly worse version of a thing the team already trusts. So, the ask was simple and disciplined before another line of scoring code. Search the
The search results: Verifying the vendor runway gap across 100 recipes
[0:40]Whole recipe library for anything doing runway or financial health work. Not a vague, I think it's new, an actual search with an actual written verdict I can point to if anyone asks. Confirm the gap is real in writing. Here's the verdict I wrote. I searched all hundred recipes. No recipe computes vendor runway as a standalone sourced gated artifact. The closest one mentions runway and passing inside a bigger multi- aent brief but never actually computes it. So the gap is real and now that's documented, not assumed. With the gap confirmed, I wrote the formal recipe spec. This is the front matter at the top. The machine readable header that says what this recipe is and crucially
Writing the recipe spec: Inside the "Status draft" header
[1:16]What state it's in. Status draft five open to each one a type placeholder for work not yet done. This header is a promise about honesty. The label always tells the truth about maturity. And here's the discipline that ties it together. The life cycle. A recipe climbs a ladder. Draft specified runnable sample and up. You don't move a rung because you feel ready. You move it because there's evidence in the run log to justify it. This week, the recipe earned its first honest label. Every future rung has to be earned the same way. So, what does the boring week teach? That checking and documenting aren't overhead. They're the
The recipe maturity ladder: Moving up based on run log evidence
[1:50]Engineering. A searched written verdict means you're not duplicating work. An honest status label means nobody, including future you, mistakes a draft for a finished tool. The unglamorous week is what makes the glamorous weeks trustworthy. Your turn before your next project. Spend 20 minutes on the boring part. Search whatever repo or system you're adding to. Does your idea already exist? Write one honest sentence about what state your work is really in. Not the state you wish it were, the state it's in. That sentence will save you from lying to yourself later. Check before you build. The boring week is the one that keeps the rest honest. Next week, I try to break my own tool.
More from Mycroft Financial AI
2:27Mycroft: Why Our AI Runway Scorer Refuses to Make Judgements
3:20Mycroft's ECIS Ep. 4: Who Said It? Weighting Context in AI Financial Analysis
2:24Mycroft Ep. 2: One Run, Two Customers (Human-Readable vs. Machine JSON)
3:14Mycroft's ECIS Ep. 3: Scaling to Three Models & Verifying AI Uncertainty
6:18Mycroft: Rebuilding Morgan Stanley's AI Tools (And Finding a Hidden Bug)
2:56