Weekly archive
New local AI models, Jul 28 – Aug 3, 2025
10 open models released Jul 28 – Aug 3, 2025, with how each runs on five reference devices.
-
88Excellent quality (A+) · 88 of 100: how capable the model is at FP16, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
-
78Great quality (A) · 78 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
-
78Great quality (A) · 78 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
-
77Great quality (A) · 77 of 100: how capable the model is at F16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
-
52Fair quality (C) · 52 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
- Phone iPhone 17 Pro Runs welltight fit 12.9 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 43.3 tok/s
- Gaming PC RTX 5090 32 GB Runs great 68.8 tok/s
- Edge board Jetson Orin NX 16 GB Runs well 16.8 tok/s
- Workstation Mac Studio 512 GB Runs great 58.8 tok/s
-
42Fair quality (C) · 42 of 100: how capable the model is at F16, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
- Phone iPhone 17 Pro Runs well 23.0 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 39.1 tok/s
- Gaming PC RTX 5090 32 GB Runs great 122 tok/s
- Edge board Jetson Orin NX 16 GB Runs well 29.8 tok/s
- Workstation Mac Studio 512 GB Runs great 48.1 tok/s
-
40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
- Phone iPhone 17 Pro Runs well 21.0 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 48.7 tok/s
- Gaming PC RTX 5090 32 GB Runs great 112 tok/s
- Edge board Jetson Orin NX 16 GB Runs well 27.2 tok/s
- Workstation Mac Studio 512 GB Runs great 44.0 tok/s
-
22Basic quality (D) · 22 of 100: how capable the model is at F16, whatever it runs on. Match score 52/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
- Phone iPhone 17 Pro Runs great 44.7 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 42.5 tok/s
- Gaming PC RTX 5090 32 GB Runs great 288 tok/s
- Edge board Jetson Orin NX 16 GB Runs great 48.7 tok/s
- Workstation Mac Studio 512 GB Runs great 113 tok/s
-
8Basic quality (D) · 8 of 100: how capable the model is at F16, whatever it runs on. Match score 45/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
- Phone iPhone 17 Pro Runs great 42.1 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 141 tok/s
- Gaming PC RTX 5090 32 GB Runs great 956 tok/s
- Edge board Jetson Orin NX 16 GB Runs great 54.6 tok/s
- Workstation Mac Studio 512 GB Runs great 376 tok/s
-
6Basic quality (D) · 6 of 100: how capable the model is at F16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking.
Runs on
- Phone iPhone 17 Pro Runs great 84.2 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 282 tok/s
- Gaming PC RTX 5090 32 GB Runs great 1,911 tok/s
- Edge board Jetson Orin NX 16 GB Runs great 109 tok/s
- Workstation Mac Studio 512 GB Runs great 752 tok/s
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.