LLMs · Reflection AI
Beam 1.0 (501B-A23B)
- Parameters
- 501B (23.4B active)
- Architecture
- Mixture of experts
- Max context
- 1,024K tokens
- License
- apache-2.0
- Released
- 2026-10
How to run it
On a mobile device
Beam 1.0 (501B-A23B) is too big for a device like yours: it needs more memory than the device has. Models that run on mobile devices.
Ollama
Ollama offers this only as a cloud model (it runs on Ollama’s servers, not your machine). To run it locally, use the GGUF files below.
Quantized files · GGUF
Works in LM Studio, llama.cpp, Jan and Ollama. No sign-in needed.
huggingface.co/unsloth/Beam-1.0-501B-A23B-GGUF (opens in a new tab)
ollama run hf.co/unsloth/Beam-1.0-501B-A23B-GGUFOriginal weights · Hugging Face
Full-precision files from Reflection AI, for fine-tuning, vLLM, Transformers.
huggingface.co/reflection/Beam-1.0-501B-A23B (opens in a new tab)
Apps that run Beam 1.0 (501B-A23B)
Our pick for each kind of computer, assuming the model fits in its memory. Pick your own GPU or device in the Model Finder for an exact answer.
| App | Type | Opens it as | Systems | Engine | Start |
|---|---|---|---|---|---|
| LM Studio | Desktop app | GGUF | macOSWindowsLinux | Open in LM Studio | |
| Ollama | CLI + API | GGUF from Hugging Face | macOSWindowsLinux |
|
|
| llama.cpp | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Jan | Desktop app | GGUF | macOSWindowsLinux | Open in Jan | |
| vLLM | Server | Original weights | WSLWindowsLinux |
|
|
| SGLang | Server | Original weights | WSLWindowsLinux |
|
|
| Docker Model Runner | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Lemonade | Desktop app | GGUF | macOSWindowsLinux |
|
|
| Unsloth Desktop | Desktop app | GGUF | macOSWindowsLinux | Open in Unsloth Desktop | |
| Atomic Chat | Desktop app | GGUF | macOSWindowsLinux | Open in Atomic Chat | |
| Pi | Coding agent | GGUF | macOSWindowsLinux | ||
| Hermes Agent | Assistant | GGUF | macOSWSLWindowsLinux | ||
| OpenClaw | Assistant | GGUF | macOSWSLWindowsLinux | ||
| OpenCode | Coding agent | GGUF | macOSWindowsLinux | ||
| Codex CLI | Coding agent | GGUF | macOSWSLWindowsLinux | ||
| OpenHands | Coding agent | GGUF | macOSWSLWindowsLinux | ||
| Zed | Coding agent | GGUF | macOSWindowsLinux | ||
| Cline | Coding agent | GGUF | macOSWindowsLinux | ||
| Open Interpreter | Coding agent | GGUF | macOSWindowsLinux | ||
| Goose | Coding agent | GGUF | macOSWindowsLinux | ||
| Aider | Coding agent | GGUF | macOSWindowsLinux | ||
| Crush | Coding agent | GGUF | macOSWindowsLinux | ||
| Qwen Code | Coding agent | GGUF | macOSWindowsLinux | ||
| Kilo Code | Coding agent | GGUF | macOSWindowsLinux | ||
| Open WebUI | Assistant | GGUF | macOSWindowsLinux | ||
| Khoj | Assistant | GGUF | macOSWindowsLinux | ||
| Letta | Assistant | GGUF | macOSWindowsLinux | ||
| KoboldCpp | Desktop app | GGUF | macOSWindowsLinux | Get KoboldCpp | |
| Text Generation WebUI | Desktop app | GGUF | macOSWindowsLinux | Get Text Generation WebUI | |
| llamafile | CLI + API | GGUF | macOSWindowsLinux | Get llamafile | |
| Msty Studio | Desktop app | GGUF | macOSWindowsLinux | Open in Msty Studio | |
| Llama (macOS) | Desktop app | GGUF | macOS | Open in Llama (macOS) | |
| RecurseChat | Desktop app | GGUF | macOS | Open in RecurseChat | |
| node-llama-cpp | Library | GGUF | macOSWindowsLinux | Get node-llama-cpp | |
| Continue | Coding agent | GGUF | macOSWindowsLinux | ||
| SillyTavern | Assistant | GGUF | macOSWindowsLinux | ||
| LibreChat | Assistant | GGUF | macOSWindowsLinux | ||
| Cherry Studio | Assistant | GGUF | macOSWindowsLinux | ||
| Chatbox | Assistant | GGUF | macOSWindowsLinux | ||
| PrivateGPT | Assistant | GGUF | macOSWindowsLinux | ||
| PocketPal AI | Mobile app | GGUF | iOSAndroid | App Store Google Play | |
| ChatterUI | Mobile app | GGUF | Android | Download the APK | |
| LLM Farm | Mobile app | GGUF | iOS |
Memory needed
Weights plus KV cache and runtime overhead. Leave a little extra free for the operating system and other apps. Try another context length.
| Quantization | Quality | Weights | Total at 8K context | Total at 32K context | Download |
|---|---|---|---|---|---|
Q2_K |
Low | 201 GB | 201 GB | 202 GB | GGUF (UD-Q2_K_XL) · folder (opens in a new tab) |
Q3_K_M |
Low | 246 GB | 247 GB | 247 GB | GGUF (UD-Q3_K_XL) · folder (opens in a new tab) |
Q4_K_M |
Good | 306 GB | 307 GB | 308 GB | GGUF (UD-Q4_K_XL) · folder (opens in a new tab) |
Q5_K_M |
High | 356 GB | 357 GB | 358 GB | GGUF (UD-Q5_K_XL) · folder (opens in a new tab) |
Q6_K |
High | 411 GB | 412 GB | 413 GB | GGUF (UD-Q6_K_XL) · folder (opens in a new tab) |
Q8_0 |
Very high | 531 GB | 532 GB | 533 GB | GGUF · folder (opens in a new tab) |
F16 |
Full | 1,003 GB | 1,003 GB | 1,004 GB | GGUF · folder (opens in a new tab) Original weights (opens in a new tab) |
Best hardware for Beam 1.0 (501B-A23B)
| Quality | Hardware | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Apple M3 Ultra (512 GB) |
Q4_K_M | 337 GB / 384 GB | 32.9 tok/s | Runs welltight fit |
| 89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking. | Apple M5 Ultra (512 GB) |
Q4_K_M | 337 GB / 384 GB | 45.8 tok/s | Runs welltight fit |
| 79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI350X |
Q3_K_M | 261 GB / 288 GB | 186 tok/s | Runs welltight fit |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI325X |
Q2_K | 214 GB / 256 GB | 186 tok/s | Runs great |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GB300 Grace Blackwell Ultra Desktop Superchip |
Q2_K | 214 GB / 252 GB | 210 tok/s | Runs great |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI300X |
Q2_K | 211 GB / 192 GB | 45.6 tok/s | Runs welloffloads to RAM |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking. | Apple M3 Ultra (256 GB) |
Q2_K | 217 GB / 192 GB | 43.4 tok/s | Slowfar over GPU memory limit |
| 91Excellent quality (A+) · 91 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. | AMD EPYC 7002 / 7003 series NAS (512 GB) |
Q5_K_M | 394 GB / 471 GB | 4.8 tok/s | Slow |
| 79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. | Intel Xeon Silver (4100 to 4300 series) NAS (512 GB) |
Q3_K_M | 284 GB / 471 GB | 3.7 tok/s | Slow |
| 79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. | Intel Xeon W-2100 series NAS (512 GB) |
Q3_K_M | 284 GB / 471 GB | 3.6 tok/s | Slow |
Run it on a cluster
Devices that can’t run Beam 1.0 (501B-A23B) alone can run it together. These example clusters do:
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.








