LLMs · DeepReinforce
Ornith 1.5 122B-A10B
- Parameters
- 125B (10.0B active)
- Architecture
- Mixture of experts
- Max context
- 256K tokens
- License
- mit
- Released
- 2026-10
How to run it
On a mobile device
Ornith 1.5 122B-A10B is too big for a device like yours: it needs more memory than the device has. Models that run on mobile devices.
Quantized files · GGUF
Works in LM Studio, llama.cpp, Jan and Ollama. No sign-in needed.
huggingface.co/ornith-ai/Ornith-1.5-122B-GGUF (opens in a new tab)
ollama run hf.co/ornith-ai/Ornith-1.5-122B-GGUFOriginal weights · Hugging Face
Full-precision files from DeepReinforce, for fine-tuning, vLLM, Transformers.
huggingface.co/ornith-ai/Ornith-1.5-122B (opens in a new tab)
Apps that run Ornith 1.5 122B-A10B
Our pick for each kind of computer, assuming the model fits in its memory. Pick your own GPU or device in the Model Finder for an exact answer.
| App | Type | Opens it as | Systems | Engine | Start |
|---|---|---|---|---|---|
| LM Studio | Desktop app | GGUF | macOSWindowsLinux | Open in LM Studio | |
| Ollama | CLI + API | GGUF from Hugging Face | macOSWindowsLinux |
|
|
| llama.cpp | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Jan | Desktop app | GGUF | macOSWindowsLinux | Open in Jan | |
| vLLM | Server | Original weights | WSLWindowsLinux |
|
|
| SGLang | Server | Original weights | WSLWindowsLinux |
|
|
| Docker Model Runner | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Lemonade | Desktop app | GGUF | macOSWindowsLinux |
|
|
| Unsloth Desktop | Desktop app | GGUF | macOSWindowsLinux | Open in Unsloth Desktop | |
| Atomic Chat | Desktop app | GGUF | macOSWindowsLinux | Open in Atomic Chat | |
| Pi | Coding agent | GGUF | macOSWindowsLinux | ||
| Hermes Agent | Assistant | GGUF | macOSWSLWindowsLinux | ||
| OpenClaw | Assistant | GGUF | macOSWSLWindowsLinux | ||
| OpenCode | Coding agent | GGUF | macOSWindowsLinux | ||
| Codex CLI | Coding agent | GGUF | macOSWSLWindowsLinux | ||
| OpenHands | Coding agent | GGUF | macOSWSLWindowsLinux | ||
| Zed | Coding agent | GGUF | macOSWindowsLinux | ||
| Cline | Coding agent | GGUF | macOSWindowsLinux | ||
| Open Interpreter | Coding agent | GGUF | macOSWindowsLinux | ||
| Goose | Coding agent | GGUF | macOSWindowsLinux | ||
| Aider | Coding agent | GGUF | macOSWindowsLinux | ||
| Crush | Coding agent | GGUF | macOSWindowsLinux | ||
| Qwen Code | Coding agent | GGUF | macOSWindowsLinux | ||
| Kilo Code | Coding agent | GGUF | macOSWindowsLinux | ||
| Open WebUI | Assistant | GGUF | macOSWindowsLinux | ||
| Khoj | Assistant | GGUF | macOSWindowsLinux | ||
| Letta | Assistant | GGUF | macOSWindowsLinux | ||
| KoboldCpp | Desktop app | GGUF | macOSWindowsLinux | Get KoboldCpp | |
| Text Generation WebUI | Desktop app | GGUF | macOSWindowsLinux | Get Text Generation WebUI | |
| llamafile | CLI + API | GGUF | macOSWindowsLinux | Get llamafile | |
| Msty Studio | Desktop app | GGUF | macOSWindowsLinux | Open in Msty Studio | |
| Llama (macOS) | Desktop app | GGUF | macOS | Open in Llama (macOS) | |
| RecurseChat | Desktop app | GGUF | macOS | Open in RecurseChat | |
| node-llama-cpp | Library | GGUF | macOSWindowsLinux | Get node-llama-cpp | |
| Continue | Coding agent | GGUF | macOSWindowsLinux | ||
| SillyTavern | Assistant | GGUF | macOSWindowsLinux | ||
| LibreChat | Assistant | GGUF | macOSWindowsLinux | ||
| Cherry Studio | Assistant | GGUF | macOSWindowsLinux | ||
| Chatbox | Assistant | GGUF | macOSWindowsLinux | ||
| PrivateGPT | Assistant | GGUF | macOSWindowsLinux | ||
| PocketPal AI | Mobile app | GGUF | iOSAndroid | App Store Google Play | |
| ChatterUI | Mobile app | GGUF | Android | Download the APK | |
| LLM Farm | Mobile app | GGUF | iOS |
Memory needed
Weights plus KV cache and runtime overhead. Leave a little extra free for the operating system and other apps. Try another context length.
| Quantization | Quality | Weights | Total at 8K context | Total at 32K context | Download |
|---|---|---|---|---|---|
Q2_K |
Low | 50.0 GB | 50.8 GB | 51.4 GB | GGUF files (opens in a new tab) |
Q3_K_M |
Low | 61.3 GB | 62.1 GB | 62.7 GB | GGUF files (opens in a new tab) |
Q4_K_M |
Good | 76.3 GB | 77.1 GB | 77.7 GB | GGUF (opens in a new tab) |
Q5_K_M |
High | 88.8 GB | 89.6 GB | 90.2 GB | GGUF (opens in a new tab) |
Q6_K |
High | 103 GB | 103 GB | 104 GB | GGUF (opens in a new tab) |
Q8_0 |
Very high | 133 GB | 133 GB | 134 GB | GGUF (opens in a new tab) |
F16 |
Full | 250 GB | 251 GB | 252 GB | GGUF (opens in a new tab) Original weights (opens in a new tab) |
Best hardware for Ornith 1.5 122B-A10B
The least expensive GPU in our catalog that runs it without offloading is the NVIDIA RTX PRO 6000 Blackwell (launch price $8,565) at Q5_K_M.
| Quality | Hardware | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking. | Apple M2 Ultra (192 GB) |
Q6_K | 115 GB / 144 GB | 48.4 tok/s | Runs great |
| 91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Apple M3 Ultra (256 GB) |
Q6_K | 119 GB / 192 GB | 49.4 tok/s | Runs great |
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA RTX PRO 6000 Blackwell |
Q5_K_M | 94.4 GB / 96.0 GB | 111 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Apple M4 Max (128 GB) |
Q4_K_M | 84.8 GB / 96.0 GB | 48.3 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA RTX Spark N1X (6144-core GPU) (128 GB) |
Q4_K_M | 85.3 GB / 102 GB | 32.8 tok/s | Runs great |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GB10 (128 GB) |
Q4_K_M | 86.3 GB / 115 GB | 30.1 tok/s | Runs great |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking. | AMD Ryzen AI Max+ 395 (128 GB) |
Q4_K_M | 84.8 GB / 96.0 GB | 24.8 tok/s | Runs welltight fit |
| 91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | Apple M3 Ultra (512 GB) |
Q6_K | 134 GB / 384 GB | 49.4 tok/s | Runs great |
| 92Excellent quality (A+) · 92 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI300X |
Q8_0 | 143 GB / 192 GB | 137 tok/s | Runs great |
| 92Excellent quality (A+) · 92 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking. | Apple M5 Ultra (256 GB) |
Q8_0 | 149 GB / 192 GB | 51.8 tok/s | Runs great |
Run it on a cluster
Devices that can’t run Ornith 1.5 122B-A10B alone can run it together. These example clusters do:
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.








