Beam 1.0 (501B-A23B) on Apple M3 Ultra (256 GB)
Can the Apple M3 Ultra (256 GB) run Beam 1.0 (501B-A23B)?
Yes, but slowly (far over GPU memory limit)
Slow (far over GPU memory limit). At Q2_K it needs about 217 GB of 192 GB usable, with an estimated speed of 43.4 tok/s.
- Best quant
Q2_K- Generation speed
- 43.4 tok/s
- Prompt processing
- 752 tok/s
- First token (1K prompt)
- 1.4 s
- Largest safe context
- —
Best app to run it on the Apple M3 Ultra (256 GB)
On macOS
- Splits the model between GPU memory and system RAM, which this setup needs.
- Point-and-click: search, download and chat in one window.
Download Beam 1.0 (501B-A23B)
Recommended for the Apple M3 Ultra (256 GB): Q2_K. Every other quantization has its own download link in the table below.
Ollama
Ollama offers this only as a cloud model (it runs on Ollama’s servers, not your machine). To run it locally, use the GGUF files below.
Quantized files · GGUF
Works in LM Studio, llama.cpp, Jan and Ollama. No sign-in needed.
Download the Q2_K (UD-Q2_K_XL) files (opens in a new tab)
huggingface.co/unsloth/Beam-1.0-501B-A23B-GGUF (opens in a new tab)
ollama run hf.co/unsloth/Beam-1.0-501B-A23B-GGUFOriginal weights · Hugging Face
Full-precision files from Reflection AI, for fine-tuning, vLLM, Transformers.
huggingface.co/reflection/Beam-1.0-501B-A23B (opens in a new tab)
How it’s rated
Match score
To order lists, each result also gets a match score out of 100 from four parts. It favors the most capable model that still runs well.
| Model quality | 29.7 / 45 | |
|---|---|---|
| Memory fit | 4.0 / 25 | |
| Speed | 15.0 / 15 | |
| Memory use | 15.0 / 15 | |
| Match score | 63.7 / 100 |
Every quantization on the Apple M3 Ultra (256 GB)
| Quant | Memory needed | Available | Speed | Runs | Quality | Download |
|---|---|---|---|---|---|---|
Q2_K | 217 GB | 192 GB | 43.4 tok/s | Slowfar over GPU memory limit | 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking. | GGUF (UD-Q2_K_XL) · folder (opens in a new tab) |
Q3_K_M | 262 GB | 192 GB | — | Won't run | 79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 10/100 (quality, fit, speed and memory use) sets the ranking. | GGUF (UD-Q3_K_XL) · folder (opens in a new tab) |
Q4_K_M | 322 GB | 192 GB | — | Won't run | 89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 12/100 (quality, fit, speed and memory use) sets the ranking. | GGUF (UD-Q4_K_XL) · folder (opens in a new tab) |
Q5_K_M | 372 GB | 192 GB | — | Won't run | 91Excellent quality (A+) · 91 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 12/100 (quality, fit, speed and memory use) sets the ranking. | GGUF (UD-Q5_K_XL) · folder (opens in a new tab) |
Q6_K | 427 GB | 192 GB | — | Won't run | 93Excellent quality (A+) · 93 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 12/100 (quality, fit, speed and memory use) sets the ranking. | GGUF (UD-Q6_K_XL) · folder (opens in a new tab) |
Q8_0 | 548 GB | 192 GB | — | Won't run | 94Excellent quality (A+) · 94 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 12/100 (quality, fit, speed and memory use) sets the ranking. | GGUF · folder (opens in a new tab) |
F16 | 1,019 GB | 192 GB | — | Won't run | 94Excellent quality (A+) · 94 of 100: how capable the model is at F16, whatever it runs on. Match score 12/100 (quality, fit, speed and memory use) sets the ranking. | GGUF · folder (opens in a new tab) Original weights (opens in a new tab) |
Memory figures assume 8K of context. Longer conversations or documents grow the KV cache.
Other hardware that runs it
-
89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.
Apple M3 Ultra (512 GB)
-
89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking.
Apple M5 Ultra (512 GB)
-
79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.
AMD Instinct MI350X
-
66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.
AMD Instinct MI325X
-
66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.
NVIDIA GB300 Grace Blackwell Ultra Desktop Superchip
-
66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking.
AMD Instinct MI300X
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.