Firehose

Most AI model routers, which automatically select the most cost-effective LLM for a given request, have been shown to be ineffective due to complexity not being fully deducible from the prompt alone, and cache being a more effective way to reduce costs. AI summary