Hardware · NVIDIA

What AI models can the NVIDIA GeForce RTX 4080 SUPER run?

VRAM
16.0 GB
Usable for models
16.0 GB
Memory bandwidth
736 GB/s
FP16 compute
52.2 TFLOPS
Released
2024
Launch price
$999

Specifications

MakerNVIDIA
TypeGraphics card
Video memory (VRAM)16.0 GB
Usable for AI models16.0 GB
Memory bandwidth736 GB/s
FP16 compute52.2 TFLOPS
InterfacePCIe 4.0
Released2024
Launch price (US)$999

Best LLMs for the NVIDIA GeForce RTX 4080 SUPER

Grade · points Model Quant Memory Speed Fit
91 ptsExcellent (S) · 91 of 100 points: Model quality 37.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 12BGoogle Q6_K 11.9 GB 52.4 tok/s Runs well
90 ptsExcellent (S) · 90 of 100 points: Model quality 36.1/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.8 27BAlibaba Q3_K_M 15.5 GB 42.0 tok/s Tight fit
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.5 9BDeepReinforce Q8_0 11.9 GB 47.7 tok/s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 35.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.6 27BAlibaba Q3_K_M 15.5 GB 42.0 tok/s Tight fit
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.5 9BAlibaba Q8_0 11.9 GB 47.7 tok/s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.5 27BAlibaba Q3_K_M 15.5 GB 42.0 tok/s Tight fit
88 ptsExcellent (S) · 88 of 100 points: Model quality 35.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 26B-A4BGoogle Q3_K_M 14.4 GB 154 tok/s Tight fit
88 ptsExcellent (S) · 88 of 100 points: Model quality 33.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.0 9BDeepReinforce Q8_0 11.9 GB 47.7 tok/s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 33.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 TMax 9BAi2 Q8_0 11.2 GB 51.4 tok/s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 TMax 27BAi2 Q3_K_M 15.3 GB 42.7 tok/s Tight fit
87 ptsExcellent (S) · 87 of 100 points: Model quality 33.3/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Fara 1.5 27BMicrosoft Q3_K_M 15.3 GB 42.7 tok/s Tight fit
86 ptsExcellent (S) · 86 of 100 points: Model quality 32.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 UI-Mate 27BTencent Q3_K_M 15.3 GB 42.7 tok/s Tight fit

Best Image models for the NVIDIA GeForce RTX 4080 SUPER

Grade · points Model Precision Memory Time per output Fit
92 ptsExcellent (S) · 92 of 100 points: Model quality 37.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) Q8 GGUF 13.0 GB 4.1 s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs Q8 GGUF 10.5 GB 1.6 s Runs well
87 ptsExcellent (S) · 87 of 100 points: Model quality 37.4/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs Q8 GGUF 12.3 GB 3.1 s Runs well
86 ptsExcellent (S) · 86 of 100 points: Model quality 36.2/45, Memory fit 25.0/25, Speed 10.2/15, Memory use 15.0/15 Z-ImageAlibaba (Tongyi) FP8 12.6 GB 22 s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Lumina-Image 2.0Shanghai AI Lab FP16 12.7 GB 9.9 s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 34.3/45, Memory fit 23.0/25, Speed 10.5/15, Memory use 15.0/15 FLUX.1 Krea [dev]Black Forest Labs Q4 GGUF 14.8 GB 20 s Tight fit

Best Video models for the NVIDIA GeForce RTX 4080 SUPER

Grade · points Model Precision Memory Time per output Fit
77 ptsGreat (A) · 77 of 100 points: Model quality 22.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 2BLightricks FP8 10.8 GB 32 s Runs well
75 ptsGreat (A) · 75 of 100 points: Model quality 24.3/45, Memory fit 25.0/25, Speed 11.5/15, Memory use 15.0/15 Wan 2.1 T2V 1.3BAlibaba FP8 12.8 GB 5.1 min Runs well
75 ptsGreat (A) · 75 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 13.3/15, Memory use 15.0/15 CogVideoX 5BZhipu AI FP8 14.3 GB 3.8 min Tight fit
75 ptsGreat (A) · 75 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 13.3/15, Memory use 15.0/15 CogVideoX 5B I2VZhipu AI FP8 14.9 GB 3.8 min Tight fit
74 ptsGreat (A) · 74 of 100 points: Model quality 19.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP8 11.0 GB 76 s Runs well

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.