Weekly archive

New local AI models, Sep 15–21, 2025

10 open models released Sep 15–21, 2025, with how each runs on five reference devices.

Jina Reranker v3

Jina AI · Decision · 600M · released Sep 18

84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
Memory, every quant and how to run it Check your own device
gpt-oss-safeguard 120B

OpenAI · Decision · 117B (5.1B active) · released Sep 18

80Great quality (A) · 80 of 100: how capable the model is at MXFP4, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
Memory, every quant and how to run it Check your own device
Ring Flash 2.0 (100B-A6B)

Ant Group (inclusionAI) · LLM · 103B (6.1B active) · released Sep 19

78Great quality (A) · 78 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
Memory, every quant and how to run it Check your own device
Ling Flash 2.0 (100B-A6B)

Ant Group (inclusionAI) · LLM · 103B (6.1B active) · released Sep 17

76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
Memory, every quant and how to run it Check your own device
gpt-oss-safeguard 20B

OpenAI · Decision · 22B (3.6B active) · released Sep 18

76Great quality (A) · 76 of 100: how capable the model is at MXFP4, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
Memory, every quant and how to run it Check your own device
Qwen3-Omni 30B-A3B Instruct

Alibaba · LLM · 35B (3.3B active) · released Sep 20

70Great quality (A) · 70 of 100: how capable the model is at F16, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
- Phone iPhone 17 Pro Won't runover the app memory limit
- Laptop MacBook Pro M5 Pro 64 GB Runs great 54.8 tok/s
- Gaming PC RTX 5090 32 GB Runs welltight fit 173 tok/s
- Edge board Jetson Orin NX 16 GB Won't run
- Workstation Mac Studio 512 GB Runs great 48.5 tok/s
Memory, every quant and how to run it Check your own device
Granite 4.0 H Small (32B-A9B)

IBM · LLM · 32B (9.0B active) · released Sep 16

62Good quality (B) · 62 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
- Phone iPhone 17 Pro Won't runover the app memory limit
- Laptop MacBook Pro M5 Pro 64 GB Runs great 32.2 tok/s
- Gaming PC RTX 5090 32 GB Runs great 118 tok/s
- Edge board Jetson Orin NX 16 GB Runs wellover GPU memory limit 18.2 tok/s
- Workstation Mac Studio 512 GB Runs great 41.3 tok/s
Memory, every quant and how to run it Check your own device
Granite 4.0 H Tiny (7B-A1B)

IBM · LLM · 6.9B (1.0B active) · released Sep 16

44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
- Phone iPhone 17 Pro Runs great 62.5 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 57.1 tok/s
- Gaming PC RTX 5090 32 GB Runs great 158 tok/s
- Edge board Jetson Orin NX 16 GB Runs great 51.5 tok/s
- Workstation Mac Studio 512 GB Runs great 108 tok/s
Memory, every quant and how to run it Check your own device
Granite 4.0 Micro (3B)

IBM · LLM · 3.4B · released Sep 16

40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
- Phone iPhone 17 Pro Runs well 28.5 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 48.6 tok/s
- Gaming PC RTX 5090 32 GB Runs great 152 tok/s
- Edge board Jetson Orin NX 16 GB Runs great 37.0 tok/s
- Workstation Mac Studio 512 GB Runs great 59.7 tok/s
Memory, every quant and how to run it Check your own device
Granite 4.0 H Micro

IBM · LLM · 3.2B · released Sep 16

38Basic quality (D) · 38 of 100: how capable the model is at F16, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
- Phone iPhone 17 Pro Runs great 30.4 tok/s
- Laptop MacBook Pro M5 Pro 64 GB Runs great 51.8 tok/s
- Gaming PC RTX 5090 32 GB Runs great 162 tok/s
- Edge board Jetson Orin NX 16 GB Runs great 39.4 tok/s
- Workstation Mac Studio 512 GB Runs great 63.7 tok/s
Memory, every quant and how to run it Check your own device

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.