Matan Grinberg
@matanSF
Big Token hates this one simple trick!
Dynamic model routing allows for a more efficient free market across the model providers.
This puts pricing pressure on them to provide the best/fastest/cheapest tokens for any given task, lest the tokens get routed to a competing model.
Dynamic model routing allows for a more efficient free market across the model providers.
This puts pricing pressure on them to provide the best/fastest/cheapest tokens for any given task, lest the tokens get routed to a competing model.
Factory@FactoryAI · Sep 24Factory Router now cuts inference costs by 63% in production, up from 42% in late June, while routed session volume grew roughly 4x.
Open quoted post →
9 86