Guides · 4 min read

Small “decision” models: classifiers, safety filters and rerankers

Models that return a label or a probability instead of prose: where they are useful and why they run almost anywhere.

Most of this site is about models that write text. Decision models do something different: they read some text and return a judgment, such as a label, a probability or a ranking, instead of a paragraph.

What kinds there are

Why they are interesting

Reading the ratings here

Because they are measured in latency, not tokens per second, these models are rated on how quickly they return an answer. The grade and Runs labels work as everywhere else (ratings). Libraries and servers that run them, such as Sentence Transformers, GLiNER, Infinity and Text Embeddings Inference, are on the apps page.

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.