Home / Figures / Chapter 10

Figure 10.3: Routing

Routing.
Figure 10.3 Routing. A classifier reads each incoming request once and sends it down the branch built for its kind; the router (in accent) is the whole pattern's pivot. Each branch then carries its own focused prompt, its own tools, and its own model tier—strict guardrails for refunds, a more capable model for technical work, a small cheap one for the general case. Separating the kinds ends the tug-of-war of one prompt serving all of them, and choosing a cheaper tier for the common inputs is the standard first lever on cost.