An NVIDIA DGX Spark (128 GB) and a 512 GB Mac Studio on 10 Gb Ethernet, the pairing EXO used to split prompt reading from typing.
The pairing from EXO's research demo, where the Spark read long prompts and the Mac typed. The public EXO app can't join a Linux machine and a Mac, so today this runs through llama.cpp RPC, and the 128 GB Spark adds little to a 512 GB Mac: a few models move from an over-committed Mac to a comfortable fit.
llama.cpp RPCbest estimate for 17 of the 18 models the cluster adds
Mixed devices you already own, a Mac, a gaming PC, a mini PC or a Jetson, when one GGUF model won't fit on any of them alone.
ggml-rpc-server --host 0.0.0.0 --port 50052 -c # on each worker
llama-server -hf <model-GGUF> -ngl 99 --rpc 192.168.1.10:50052,192.168.1.11:50052 # on the main machine
Also works. The number is how many of the added models each one runs:
Watch it run: one device, the cluster, every device
The same answer on this cluster, at our estimated speeds. First the model reads your prompt (the devices light up blue), then it types. In a pipeline split the devices take turns on every word; in a tensor split they all work on each word together.
612 LLMs this cluster can run
Models the cluster adds come first, best match first, then the ones a single device already runs as well. Filter vs one device to pick. Speeds are estimates for one person chatting.
Quality
Model
Quant
Memory
Speed
Runs
Devices
Tool
vs one device
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 36.5 tok/s
A82Great quality (A) · 82 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 69.5 tok/s
A82Great quality (A) · 82 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 32.0 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 32.0 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 32.0 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 32.0 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 23.9 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Runs well on Mac, 30.6 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 33.2 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 33.2 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 33.2 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 26.0 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 33.2 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 26.0 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 33.2 tok/s
B67Good quality (B) · 67 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 21.4 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
Better on the clusterAlone: Slow on Mac, 33.2 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
AGLing 1TAnt Group (inclusionAI) · 1,000B (50.0B active)
Better on the clusterAlone: Slow on Mac, 22.2 tok/s
A+95Excellent quality (A+) · 95 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 97/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.9 tok/s
A+93Excellent quality (A+) · 93 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.6 tok/s
A+96Excellent quality (A+) · 96 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.4 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A+94Excellent quality (A+) · 94 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.7 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.6 tok/s
A+93Excellent quality (A+) · 93 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.9 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 33.4 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.4 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.9 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 33.4 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 31.0 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.0 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.6 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.9 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 31.0 tok/s
A+88Excellent quality (A+) · 88 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 32.9 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.6 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.2 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.7 tok/s
A+88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 24.8 tok/s
A+86Excellent quality (A+) · 86 of 100: how capable the model is at F16, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 22.8 tok/s
A+86Excellent quality (A+) · 86 of 100: how capable the model is at F16, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.1 tok/s
A84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 28.9 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A+86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 34.7 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A+93Excellent quality (A+) · 93 of 100: how capable the model is at F16, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.3 tok/s
A+86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.5 tok/s
A+93Excellent quality (A+) · 93 of 100: how capable the model is at F16, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+93Excellent quality (A+) · 93 of 100: how capable the model is at F16, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+85Excellent quality (A+) · 85 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 34.7 tok/s
A+88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 14.9 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 24.8 tok/s
A84Great quality (A) · 84 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 34.7 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at F16, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 34.7 tok/s
A+87Excellent quality (A+) · 87 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at F16, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.9 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at F16, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+91Excellent quality (A+) · 91 of 100: how capable the model is at F16, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 33.4 tok/s
A82Great quality (A) · 82 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.0 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 24.8 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at F16, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+92Excellent quality (A+) · 92 of 100: how capable the model is at F16, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.3 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at F16, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at F16, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.4 tok/s
A83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.0 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 34.7 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 17.7 tok/s
A+87Excellent quality (A+) · 87 of 100: how capable the model is at F16, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+88Excellent quality (A+) · 88 of 100: how capable the model is at F16, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A+87Excellent quality (A+) · 87 of 100: how capable the model is at F16, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A81Great quality (A) · 81 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 28.0 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 17.7 tok/s
A75Great quality (A) · 75 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.1 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.6 tok/s
A82Great quality (A) · 82 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A+85Excellent quality (A+) · 85 of 100: how capable the model is at F16, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A84Great quality (A) · 84 of 100: how capable the model is at MXFP4, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 113 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.7 tok/s
A+88Excellent quality (A+) · 88 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 73.7 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
B69Good quality (B) · 69 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.9 tok/s
A75Great quality (A) · 75 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 37.2 tok/s
A79Great quality (A) · 79 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.7 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 17.7 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 17.3 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.2 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at F16, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.3 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at F16, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.2 tok/s
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.2 tok/s
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.1 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at F16, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.4 tok/s
A+88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.2 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.6 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.2 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.2 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.0 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.3 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.5 tok/s
A+87Excellent quality (A+) · 87 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 29.1 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at F16, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.5 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.2 tok/s
A+85Excellent quality (A+) · 85 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Spark / Jetson, 10.1 tok/s
A+86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.7 tok/s
A82Great quality (A) · 82 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.2 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at F16, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at F16, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
A83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Spark / Jetson, 10.1 tok/s
A73Great quality (A) · 73 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.6 tok/s
A80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
IOK2 Horizon 7BInstitute of Foundation Models · 9.0B
One device is enoughAlone: Runs great on Mac, 49.0 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at F16, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at F16, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.8 tok/s
A81Great quality (A) · 81 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Spark / Jetson, 10.1 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.6 tok/s
A78Great quality (A) · 78 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.8 tok/s
A81Great quality (A) · 81 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 61.8 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.7 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.7 tok/s
C47Fair quality (C) · 47 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.5 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.2 tok/s
A75Great quality (A) · 75 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.7 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Spark / Jetson, 74.6 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 85.4 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.2 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.2 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.9 tok/s
A71Great quality (A) · 71 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.4 tok/s
A71Great quality (A) · 71 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.0 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at F16, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.1 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.1 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 23.9 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at F16, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.8 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.8 tok/s
B69Good quality (B) · 69 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.0 tok/s
B69Good quality (B) · 69 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.7 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
A75Great quality (A) · 75 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 23.9 tok/s
A74Great quality (A) · 74 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.0 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 29.6 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.1 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A77Great quality (A) · 77 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.5 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.5 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.1 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.7 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at F16, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.0 tok/s
B67Good quality (B) · 67 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.6 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 17.4 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.9 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.1 tok/s
B59Good quality (B) · 59 of 100: how capable the model is at F16, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
A72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 22.6 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.1 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.1 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at F16, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
A76Great quality (A) · 76 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.9 tok/s
B65Good quality (B) · 65 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.1 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.6 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.6 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.6 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.3 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 30.0 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 32.1 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.9 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 27.1 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.7 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.9 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.1 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.1 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.4 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at F16, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.3 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at F16, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 88.3 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.7 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.8 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at F16, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.6 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B61Good quality (B) · 61 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
B61Good quality (B) · 61 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.9 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B61Good quality (B) · 61 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.1 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.2 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 32.2 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.7 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
B61Good quality (B) · 61 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.2 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 92.8 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 22.6 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.8 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.9 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.1 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.7 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.8 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.6 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.6 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.7 tok/s
B59Good quality (B) · 59 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 40.7 tok/s
A70Great quality (A) · 70 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.0 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.9 tok/s
B59Good quality (B) · 59 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.2 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at F16, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 80.6 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 38.9 tok/s
B69Good quality (B) · 69 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.9 tok/s
B69Good quality (B) · 69 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.8 tok/s
B63Good quality (B) · 63 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 10.1 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
B68Good quality (B) · 68 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.4 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.9 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.1 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.0 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.4 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at F16, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.7 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 35.7 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.1 tok/s
B67Good quality (B) · 67 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 10.1 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 31.8 tok/s
B66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 36.7 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at F16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.9 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.4 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.4 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.3 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.4 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at F16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.5 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 55.5 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 58.1 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.7 tok/s
B55Good quality (B) · 55 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 38.9 tok/s
C51Fair quality (C) · 51 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.9 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at F16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 117 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at F16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 88.7 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at F16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 61.8 tok/s
B55Good quality (B) · 55 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
B64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.8 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.8 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at F16, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.7 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at F16, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.5 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.4 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.8 tok/s
C49Fair quality (C) · 49 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
C49Fair quality (C) · 49 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 39.9 tok/s
C49Fair quality (C) · 49 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.3 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 20.7 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at F16, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at F16, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 85.0 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
B62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.0 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.8 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.9 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.7 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.1 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.9 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.8 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.8 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 58.8 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
C52Fair quality (C) · 52 of 100: how capable the model is at F16, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 55.5 tok/s
C51Fair quality (C) · 51 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.2 tok/s
C51Fair quality (C) · 51 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 38.9 tok/s
C53Fair quality (C) · 53 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
B60Good quality (B) · 60 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.9 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.8 tok/s
B60Good quality (B) · 60 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.4 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 47.7 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at F16, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.9 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.1 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.5 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at F16, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.5 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.4 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 55.5 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 58.1 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at F16, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.2 tok/s
C49Fair quality (C) · 49 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.4 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at F16, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 106 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at F16, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.2 tok/s
B58Good quality (B) · 58 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 10.8 tok/s
C48Fair quality (C) · 48 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.5 tok/s
C48Fair quality (C) · 48 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.9 tok/s
C47Fair quality (C) · 47 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.6 tok/s
C48Fair quality (C) · 48 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C48Fair quality (C) · 48 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C48Fair quality (C) · 48 of 100: how capable the model is at F16, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.7 tok/s
C48Fair quality (C) · 48 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.4 tok/s
C50Fair quality (C) · 50 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.
C48Fair quality (C) · 48 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 83.2 tok/s
C51Fair quality (C) · 51 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 24.7 tok/s
B57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.5 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at F16, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 50.8 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.1 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.1 tok/s
B56Good quality (B) · 56 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.6 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.5 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 55.0 tok/s
C45Fair quality (C) · 45 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.0 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.4 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.1 tok/s
C45Fair quality (C) · 45 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.0 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at F16, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.9 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
B55Good quality (B) · 55 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.6 tok/s
C46Fair quality (C) · 46 of 100: how capable the model is at F16, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.7 tok/s
C45Fair quality (C) · 45 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.1 tok/s
B55Good quality (B) · 55 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.3 tok/s
C45Fair quality (C) · 45 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 47.2 tok/s
C54Fair quality (C) · 54 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.6 tok/s
B55Good quality (B) · 55 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 11.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 108 tok/s
C43Fair quality (C) · 43 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.8 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.0 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.5 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.1 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.6 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 47.2 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.8 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 136 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 79.1 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.5 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.1 tok/s
C53Fair quality (C) · 53 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 10.8 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 81.9 tok/s
C44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 75.2 tok/s
C47Fair quality (C) · 47 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 24.7 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 61.8 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.3 tok/s
C47Fair quality (C) · 47 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.2 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 52.4 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at F16, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.1 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at F16, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.9 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at F16, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 67.0 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 156 tok/s
C42Fair quality (C) · 42 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 212 tok/s
D39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.6 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.1 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 41.1 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.8 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.9 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.0 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.7 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.9 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.9 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.7 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 136 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 89.5 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 108 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 143 tok/s
D39Basic quality (D) · 39 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.8 tok/s
C40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 131 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at F16, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 85.0 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.6 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at F16, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.9 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.9 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.4 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.8 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 59.9 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at F16, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.9 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.6 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at F16, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.7 tok/s
C41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.6 tok/s
C41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 26.0 tok/s
D37Basic quality (D) · 37 of 100: how capable the model is at F16, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.6 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.4 tok/s
C41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 24.9 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 102 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.4 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.4 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.9 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 53.2 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.8 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.5 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 64.5 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.7 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 95.4 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 188 tok/s
D35Basic quality (D) · 35 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D33Basic quality (D) · 33 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 42.4 tok/s
D35Basic quality (D) · 35 of 100: how capable the model is at F16, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.3 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.1 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.6 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at F16, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.9 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.8 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.9 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.8 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at F16, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.2 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at F16, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.7 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at F16, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 79.0 tok/s
C43Fair quality (C) · 43 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 10.1 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.7 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.2 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 54.7 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.9 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at F16, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.3 tok/s
C41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.6 tok/s
D31Basic quality (D) · 31 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 44.8 tok/s
D36Basic quality (D) · 36 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 25.7 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at F16, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 174 tok/s
D29Basic quality (D) · 29 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.1 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.6 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 62.9 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 79.6 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 80.3 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 80.3 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 84.3 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 100 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 55.1 tok/s
D30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 159 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.6 tok/s
D27Basic quality (D) · 27 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.1 tok/s
D38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.8 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 58.2 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D27Basic quality (D) · 27 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 49.5 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 72.7 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 80.3 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 77.8 tok/s
D28Basic quality (D) · 28 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 139 tok/s
D24Basic quality (D) · 24 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 56.6 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 92.8 tok/s
D27Basic quality (D) · 27 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 83.2 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 51.6 tok/s
D25Basic quality (D) · 25 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 43.2 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 57.1 tok/s
D25Basic quality (D) · 25 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.1 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.9 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 68.2 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 77.2 tok/s
D25Basic quality (D) · 25 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.2 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 114 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 132 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 131 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 174 tok/s
D26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 233 tok/s
D24Basic quality (D) · 24 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D34Basic quality (D) · 34 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Mac, 12.6 tok/s
D32Basic quality (D) · 32 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
D24Basic quality (D) · 24 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 61.5 tok/s
D24Basic quality (D) · 24 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 90.3 tok/s
D24Basic quality (D) · 24 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 91.9 tok/s
D24Basic quality (D) · 24 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 132 tok/s
D24Basic quality (D) · 24 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 129 tok/s
D21Basic quality (D) · 21 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 45.0 tok/s
D21Basic quality (D) · 21 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.1 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 48.5 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 90.3 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 76.4 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 113 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 114 tok/s
D22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 164 tok/s
D19Basic quality (D) · 19 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 46.1 tok/s
D21Basic quality (D) · 21 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 106 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 58.7 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 58.4 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 72.5 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 120 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 72.7 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 119 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 132 tok/s
D20Basic quality (D) · 20 of 100: how capable the model is at F16, whatever it runs on. Match score 51/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 203 tok/s
D18Basic quality (D) · 18 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 63.8 tok/s
D18Basic quality (D) · 18 of 100: how capable the model is at F16, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 120 tok/s
D18Basic quality (D) · 18 of 100: how capable the model is at F16, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 67.0 tok/s
D18Basic quality (D) · 18 of 100: how capable the model is at F16, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 107 tok/s
D18Basic quality (D) · 18 of 100: how capable the model is at F16, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 274 tok/s
D17Basic quality (D) · 17 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 108 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 62.4 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 72.5 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 73.1 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 137 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 122 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 119 tok/s
D16Basic quality (D) · 16 of 100: how capable the model is at F16, whatever it runs on. Match score 49/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 132 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 65.4 tok/s
D15Basic quality (D) · 15 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 294 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 64.0 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 80.9 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 119 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 137 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 271 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 391 tok/s
D14Basic quality (D) · 14 of 100: how capable the model is at F16, whatever it runs on. Match score 48/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 580 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 60.2 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 80.9 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 150 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 150 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 451 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 580 tok/s
D12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 597 tok/s
D11Basic quality (D) · 11 of 100: how capable the model is at F16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 271 tok/s
D10Basic quality (D) · 10 of 100: how capable the model is at F16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 124 tok/s
D10Basic quality (D) · 10 of 100: how capable the model is at F16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 124 tok/s
D10Basic quality (D) · 10 of 100: how capable the model is at F16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 398 tok/s
D13Basic quality (D) · 13 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs well on Spark / Jetson, 10.4 tok/s
D10Basic quality (D) · 10 of 100: how capable the model is at F16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 415 tok/s
D10Basic quality (D) · 10 of 100: how capable the model is at F16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 883 tok/s
D8Basic quality (D) · 8 of 100: how capable the model is at F16, whatever it runs on. Match score 45/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 376 tok/s
D8Basic quality (D) · 8 of 100: how capable the model is at F16, whatever it runs on. Match score 45/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 415 tok/s
D8Basic quality (D) · 8 of 100: how capable the model is at F16, whatever it runs on. Match score 45/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 564 tok/s
D6Basic quality (D) · 6 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 45/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 61.0 tok/s
D6Basic quality (D) · 6 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 185 tok/s
D6Basic quality (D) · 6 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 415 tok/s
D6Basic quality (D) · 6 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 564 tok/s
D6Basic quality (D) · 6 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 781 tok/s
D6Basic quality (D) · 6 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 752 tok/s
D5Basic quality (D) · 5 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 564 tok/s
D4Basic quality (D) · 4 of 100: how capable the model is at F16, whatever it runs on. Match score 43/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 1,562 tok/s
D3Basic quality (D) · 3 of 100: how capable the model is at F16, whatever it runs on. Match score 43/100 (quality, fit, speed and memory use) sets the ranking.
One device is enoughAlone: Runs great on Mac, 2,257 tok/s
D2Basic quality (D) · 2 of 100: how capable the model is at F16, whatever it runs on. Match score 42/100 (quality, fit, speed and memory use) sets the ranking.
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.
NVIDIA GB10 (128 GB) 
Apple M3 Ultra (512 GB) 
