Economics
Architected for the running cost, not the demo
The design constraint is what one interaction costs twelve months after launch, when the pilot funding is gone. Small or open-weight models for most traffic, caching for the questions that recur, short retrieval instead of long prompts.
- Cached retrieval for the questions that recur most
- A larger model only where the task demands it
- Cost per interaction modelled before anything is built