+1 (415) 555-0142 Get a quote →

THE JOURNAL

Notes on building, shipping & securing the web.

All AI WordPress Shopify Performance Security SEO E-commerce Design DevOps Engineering

Write the evals before the prompt: testing LLM features properly

AI · 5 min

Write the evals before the prompt: testing LLM features properly

How we build evaluation sets, graders and CI gates for LLM features so that every prompt or model change is measured instead of guessed.

Daniel Reyes · Jan 14, 2025

One email a month. Only the good stuff.

Field notes from real client projects. No spam.