Level 3 · Advanced · 6 min
Model Routing
Sending each request to the cheapest model that can handle it. Big win on cost without dropping quality on hard tasks.
Sending each request to the cheapest model that can handle it. Big win on cost without dropping quality on hard tasks.