Transformer models you embed in your app to make smarter routing decisions for your agentic experience. Classify prompts, estimate reasoning effort, and detect code languages, small enough to run anywhere with negligible overhead.
This is not a routing service. These are tiny models you drop into your own stack so your agent can decide which LLM to call, how much thinking budget to set, and what context to inject, before the API request.
Live Demo
These models are running live in your browser via ONNX Runtime Web. Nothing is sent to a server.
Enter a prompt to classify its difficulty and predict reasoning effort. The router recommends which model tier to use.
Paste a code snippet. The model detects the programming language from 30 supported languages.
Start typing and the SFT model generates suggestions in real time. Press Tab to accept one word at a time.
Type in the box above to see autocomplete suggestions. Next token confidence is set to 25%. A higher threshold produces more predictable, production-ready suggestions by only surfacing tokens the model is confident about.
Models
Difficulty Classifier
Classifies prompts as Easy, Medium, or Hard and maps them to a model tier: Haiku ($), Sonnet ($$), or Opus ($$$). Stop sending simple questions to the most expensive model.
Thinking Budget Predictor
Predicts whether a prompt needs Low, Medium, or High reasoning effort. Set the thinking budget before the LLM starts generating.
30 Programming Languages
Detects code in prompts and classifies the language: Python, TypeScript, Rust, Go, Java, C++, Ruby, SQL, Haskell, FORTRAN, and 20 more. Enables language-specific context injection before the API call.
SFT Tiny GPT
A small transformer fine-tuned on 788 real-world code examples from production applications. The base model learned core language patterns; this supervised fine-tuned version generates inline prompt suggestions as you type. Real-time ghost text, accept with Tab.
How it works
Quantized ONNX models load into your browser or app on first use. They're small enough that load time is negligible.
ONNX Runtime runs inference locally, via WebAssembly in the browser or natively in Node.js. Either way, classification adds negligible latency.
Results determine which model tier to call, how much reasoning to budget, and what language context to inject. All before the first API call.
Economics
Most prompts are simple. Routing them to the right model tier saves real money.
Pricing based on Anthropic Claude models, and used for illustrative purposes only.
About
knowmatic hobby lab is a side project. I work on this in my free time because I think the future of AI routing belongs on the client, not the server. You can find more of my work on GitHub.
Every major AI platform sends your data to a server for decisions that a tiny, task-specific, model could make locally in milliseconds. For prompt routing, language detection, and effort estimation, that round trip is unnecessary.
These models are small on purpose. They run in the browser or locally in your app, load instantly, and add negligible time to your pipeline, making every API call smarter, cheaper, and faster before it even happens.
knowmatic hobby lab partners with Thundraa, led by Mohammad, on applied AI projects. We built the agentic coding evals for the opencode.ai team, helping them measure their agent's coding abilities. Now we're working together to build a custom routing model, a tiny GPT trained on real use cases from the opencode CLI that automatically matches each prompt to the best model for the task. The training data reflects how developers actually use the opencode agent, so the router learns from genuine agentic workflows rather than synthetic benchmarks.
Roadmap
Python library. pip install knowmatic, drop the models into any Python application. FastAPI middleware, Django integration, standalone CLI.
TypeScript library. npm install knowmatic, use the same models in Node.js, Deno, or any frontend framework. Works with ONNX Runtime Node for server-side or ONNX Runtime Web for the browser.
One line of code. The goal is to make prompt routing, reasoning effort estimation, and code classification available to any existing project with a single import.
Contact
Looking for investors, partners, and early customers who believe decision-making should live where the user works.