Check my GPU

Hardware · NVIDIA

What AI models can the NVIDIA GeForce RTX 4070 run?

VRAM
12.0 GB
Usable for models
12.0 GB
Memory bandwidth
504 GB/s
FP16 compute
29.1 TFLOPS
Released
2023
Launch price
$599

Specifications

MakerNVIDIA
TypeGraphics card
Video memory (VRAM)12.0 GB
Usable for AI models12.0 GB
Memory bandwidth504 GB/s
FP16 compute29.1 TFLOPS
InterfacePCIe 4.0
Released2023
Launch price (US)$599

Best LLMs for the NVIDIA GeForce RTX 4070

Grade · points Model Quant Memory Speed Fit
90 ptsExcellent (S) · 90 of 100 points: Model quality 35.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 12BGoogle Q4_K_M 9.2 GB 51.7 tok/s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.5 9BDeepReinforce Q6_K 9.4 GB 44.5 tok/s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 33.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.5 9BAlibaba Q6_K 9.4 GB 44.5 tok/s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 33.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.0 9BDeepReinforce Q6_K 9.4 GB 44.5 tok/s Runs well
87 ptsExcellent (S) · 87 of 100 points: Model quality 33.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 TMax 9BAi2 Q6_K 8.8 GB 48.0 tok/s Runs well
86 ptsExcellent (S) · 86 of 100 points: Model quality 31.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 UI-Mate 9BTencent Q6_K 9.2 GB 45.6 tok/s Runs well
86 ptsExcellent (S) · 86 of 100 points: Model quality 31.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 UI-Venus 2 9BAnt Group (inclusionAI) Q6_K 9.2 GB 45.6 tok/s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 30.6/45, Memory fit 25.0/25, Speed 14.9/15, Memory use 15.0/15 Gemma 4 E4BGoogle Q8_0 9.8 GB 39.4 tok/s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 30.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Granite 4.2 8BIBM Q6_K 9.7 GB 48.8 tok/s Runs well
84 ptsGreat (A) · 84 of 100 points: Model quality 30.8/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Apriel 1.5 15B ThinkerServiceNow Q4_K_M 11.9 GB 41.6 tok/s Tight fit
84 ptsGreat (A) · 84 of 100 points: Model quality 30.8/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Phi-4 Reasoning Plus (14B)Microsoft Q4_K_M 11.8 GB 42.2 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 29.9/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Phi-4 Reasoning (14B)Microsoft Q4_K_M 11.8 GB 42.2 tok/s Tight fit

Best Image models for the NVIDIA GeForce RTX 4070

Grade · points Model Precision Memory Time per output Fit
90 ptsExcellent (S) · 90 of 100 points: Model quality 35.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) Q4 GGUF 10.1 GB 6.6 s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs FP8 10.2 GB 2.0 s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 35.2/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs Q4 GGUF 8.0 GB 5.0 s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Juggernaut XL v9RunDiffusion FP16 8.9 GB 9.8 s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 RealVisXL V5.0SG161222 FP16 8.9 GB 9.8 s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Animagine XL 4.0Cagliostro Lab FP16 8.9 GB 9.2 s Runs well

Best Video models for the NVIDIA GeForce RTX 4070

Grade · points Model Precision Memory Time per output Fit
75 ptsGreat (A) · 75 of 100 points: Model quality 22.1/45, Memory fit 23.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 2BLightricks FP8 10.8 GB 49 s Tight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 19.8/45, Memory fit 23.0/25, Speed 15.0/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP8 11.0 GB 2.0 min Tight fit
69 ptsGood (B) · 69 of 100 points: Model quality 24.3/45, Memory fit 20.0/25, Speed 10.4/15, Memory use 15.0/15 CogVideoX 5BZhipu AI FP8 9.6 GB 6.2 min Runs well
69 ptsGood (B) · 69 of 100 points: Model quality 24.3/45, Memory fit 20.0/25, Speed 10.4/15, Memory use 15.0/15 CogVideoX 5B I2VZhipu AI FP8 10.2 GB 6.2 min Runs well
68 ptsGood (B) · 68 of 100 points: Model quality 24.8/45, Memory fit 20.0/25, Speed 8.6/15, Memory use 15.0/15 Wan 2.1 T2V 1.3BAlibaba FP16 8.4 GB 9.2 min Runs well

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.