Blog
Notes from the router and the compiler.
How Seldon routes, observes, and progressively compiles repeated LLM workflows into cheaper, deterministic data pipelines.
July 11, 202618 min read
How much of your LLM bill is just ETL?
A technical essay on measuring production LLM traffic: how to distinguish reasoning from routing, extraction, classification, normalization, lookup, and deterministic data work.
LLM opsETLCost
July 8, 202610 min read
The Silent Epidemic of LLM Technical Debt
Prompt-driven development quietly buries core application logic inside probabilistic text. Here is how to tell which LLM calls have matured into stable workflows that should become deterministic systems.
Technical debtLLM opsArchitecture
July 5, 20268 min read
Program synthesis, and why compiling LLM calls into ETL is one
What program synthesis is, and how Seldon's approach of turning repeated LLM calls into deterministic data pipelines is a restricted, example-driven form of it.
CompilerProgram synthesisETL