Hardware · NVIDIA
What AI models can the NVIDIA GeForce RTX 4080 SUPER run?
- VRAM
- 16.0 GB
- Usable for models
- 16.0 GB
- Memory bandwidth
- 736 GB/s
- FP16 compute
- 52.2 TFLOPS
- Released
- 2024
- Launch price
- $999
Specifications
| Maker | NVIDIA |
|---|---|
| Type | Graphics card |
| Video memory (VRAM) | 16.0 GB |
| Usable for AI models | 16.0 GB |
| Memory bandwidth | 736 GB/s |
| FP16 compute | 52.2 TFLOPS |
| Interface | PCIe 4.0 |
| Released | 2024 |
| Launch price (US) | $999 |
Best LLMs for the NVIDIA GeForce RTX 4080 SUPER
| Grade · points | Model | Quant | Memory | Speed | Fit |
|---|---|---|---|---|---|
| 91 ptsExcellent (S) · 91 of 100 points: Model quality 37.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | Gemma 4 12B | Q6_K | 11.9 GB | 52.4 tok/s | Runs well |
| 90 ptsExcellent (S) · 90 of 100 points: Model quality 36.1/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | Qwen3.8 27B | Q3_K_M | 15.5 GB | 42.0 tok/s | Tight fit |
| 89 ptsExcellent (S) · 89 of 100 points: Model quality 34.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | Ornith 1.5 9B | Q8_0 | 11.9 GB | 47.7 tok/s | Runs well |
| 89 ptsExcellent (S) · 89 of 100 points: Model quality 35.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | Qwen3.6 27B | Q3_K_M | 15.5 GB | 42.0 tok/s | Tight fit |
| 89 ptsExcellent (S) · 89 of 100 points: Model quality 34.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | Qwen3.5 9B | Q8_0 | 11.9 GB | 47.7 tok/s | Runs well |
| 89 ptsExcellent (S) · 89 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | Qwen3.5 27B | Q3_K_M | 15.5 GB | 42.0 tok/s | Tight fit |
| 88 ptsExcellent (S) · 88 of 100 points: Model quality 35.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | Gemma 4 26B-A4B | Q3_K_M | 14.4 GB | 154 tok/s | Tight fit |
| 88 ptsExcellent (S) · 88 of 100 points: Model quality 33.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | Ornith 1.0 9B | Q8_0 | 11.9 GB | 47.7 tok/s | Runs well |
| 88 ptsExcellent (S) · 88 of 100 points: Model quality 33.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | TMax 9B | Q8_0 | 11.2 GB | 51.4 tok/s | Runs well |
| 88 ptsExcellent (S) · 88 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | TMax 27B | Q3_K_M | 15.3 GB | 42.7 tok/s | Tight fit |
| 87 ptsExcellent (S) · 87 of 100 points: Model quality 33.3/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | Fara 1.5 27B | Q3_K_M | 15.3 GB | 42.7 tok/s | Tight fit |
| 86 ptsExcellent (S) · 86 of 100 points: Model quality 32.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 | UI-Mate 27B | Q3_K_M | 15.3 GB | 42.7 tok/s | Tight fit |
Best Image models for the NVIDIA GeForce RTX 4080 SUPER
| Grade · points | Model | Precision | Memory | Time per output | Fit |
|---|---|---|---|---|---|
| 92 ptsExcellent (S) · 92 of 100 points: Model quality 37.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | Z-Image Turbo | Q8 GGUF | 13.0 GB | 4.1 s | Runs well |
| 89 ptsExcellent (S) · 89 of 100 points: Model quality 34.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | FLUX.2 [klein] 4B | Q8 GGUF | 10.5 GB | 1.6 s | Runs well |
| 87 ptsExcellent (S) · 87 of 100 points: Model quality 37.4/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 | FLUX.2 [klein] 9B | Q8 GGUF | 12.3 GB | 3.1 s | Runs well |
| 86 ptsExcellent (S) · 86 of 100 points: Model quality 36.2/45, Memory fit 25.0/25, Speed 10.2/15, Memory use 15.0/15 | Z-Image | FP8 | 12.6 GB | 22 s | Runs well |
| 82 ptsGreat (A) · 82 of 100 points: Model quality 27.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | Lumina-Image 2.0 | FP16 | 12.7 GB | 9.9 s | Runs well |
| 82 ptsGreat (A) · 82 of 100 points: Model quality 34.3/45, Memory fit 23.0/25, Speed 10.5/15, Memory use 15.0/15 | FLUX.1 Krea [dev] | Q4 GGUF | 14.8 GB | 20 s | Tight fit |
Best Video models for the NVIDIA GeForce RTX 4080 SUPER
| Grade · points | Model | Precision | Memory | Time per output | Fit |
|---|---|---|---|---|---|
| 77 ptsGreat (A) · 77 of 100 points: Model quality 22.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | LTX-Video 2B | FP8 | 10.8 GB | 32 s | Runs well |
| 75 ptsGreat (A) · 75 of 100 points: Model quality 24.3/45, Memory fit 25.0/25, Speed 11.5/15, Memory use 15.0/15 | Wan 2.1 T2V 1.3B | FP8 | 12.8 GB | 5.1 min | Runs well |
| 75 ptsGreat (A) · 75 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 13.3/15, Memory use 15.0/15 | CogVideoX 5B | FP8 | 14.3 GB | 3.8 min | Tight fit |
| 75 ptsGreat (A) · 75 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 13.3/15, Memory use 15.0/15 | CogVideoX 5B I2V | FP8 | 14.9 GB | 3.8 min | Tight fit |
| 74 ptsGreat (A) · 74 of 100 points: Model quality 19.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 | CogVideoX 2B | FP8 | 11.0 GB | 76 s | Runs well |
Best LLMs by task on this hardware Open in Model Finder
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.