Does it run locally?
Pick your graphics card, Mac or mini PC, or let us detect it. See which LLMs, image, video and decision models fit in memory, and how fast they should run.
How the estimate works
Three numbers decide it
01 · MemoryDoes it fit?Model weights at each quantization, plus the KV cache for your context length and runtime overhead, against the memory your GPU or Mac can actually give a model.
02 · BandwidthHow fast will it answer?Generating each token reads the weights once, so tokens per second follow memory bandwidth. Mixture-of-experts models only read their active experts.
03 · QualityIs it the best that fits?A curated quality tier for each model carries most of the score, so the top pick is the best model that fits, not the smallest one.
Example
Llama 3.3 70B on a 128 GB Mac
At Q6_K it needs about 69 GB. A Mac with 128 GB of unified memory lets a model use about 96 GB, so it fits, at roughly 6 tokens per second.
Popular checks
What people ask
68Good quality (B) · 68 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.Llama 3.3 70B Instruct72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.Qwen3 32B70Great quality (A) · 70 of 100: how capable the model is at MXFP4, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.gpt-oss 20B78Great quality (A) · 78 of 100: how capable the model is at FP8, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.FLUX.1 [dev]60Good quality (B) · 60 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.Gemma 3 27B IT77Great quality (A) · 77 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.DeepSeek R1 (671B)
From the team at EnableVue
Running AI on your product catalog?
EnableVue turns messy product data and thin web content into catalogs that rank in Google and get cited by AI answer engines. Expert-led services, AI-accelerated delivery.
