Switch language한국어
Back to the list

OpenSquilla routes each turn to the cheapest model that can handle it

TL;DR AI

Key summary

2 min read
  1. OpenSquilla introduced SquillaRouter, an on-device classifier that routes each turn to the cheapest model that can still handle the task.

  2. The router works across many providers, including OpenRouter, OpenAI, Anthropic, Ollama, DeepSeek, Gemini, and Qwen.

  3. If native dependencies like ONNX Runtime or LightGBM are missing, it falls back to direct routing instead of breaking the workflow.

  4. The shift from fixed model selection to per-turn routing could cut costs, improve agent performance, and turn usage data into a training flywheel.

Read the original