Check my GPU

Hardware · NVIDIA

What AI models can the NVIDIA GeForce RTX 4060 run?

VRAM
8.0 GB
Usable for models
8.0 GB
Memory bandwidth
272 GB/s
FP16 compute
15.1 TFLOPS
Released
2023
Launch price
$299

Specifications

MakerNVIDIA
TypeGraphics card
Video memory (VRAM)8.0 GB
Usable for AI models8.0 GB
Memory bandwidth272 GB/s
FP16 compute15.1 TFLOPS
InterfacePCIe 4.0
Released2023
Launch price (US)$299

Best LLMs for the NVIDIA GeForce RTX 4060

Grade · points Model Quant Memory Speed Fit
86 ptsExcellent (S) · 86 of 100 points: Model quality 31.6/45, Memory fit 25.0/25, Speed 14.5/15, Memory use 15.0/15 TMax 9BAi2 Q4_K_M 6.7 GB 37.3 tok/s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 32.9/45, Memory fit 24.0/25, Speed 14.0/15, Memory use 15.0/15 Ornith 1.5 9BDeepReinforce Q4_K_M 7.2 GB 34.6 tok/s Tight fit
85 ptsExcellent (S) · 85 of 100 points: Model quality 32.5/45, Memory fit 24.0/25, Speed 14.0/15, Memory use 15.0/15 Qwen3.5 9BAlibaba Q4_K_M 7.2 GB 34.6 tok/s Tight fit
85 ptsExcellent (S) · 85 of 100 points: Model quality 32.1/45, Memory fit 24.0/25, Speed 14.0/15, Memory use 15.0/15 Ornith 1.0 9BDeepReinforce Q4_K_M 7.2 GB 34.6 tok/s Tight fit
84 ptsGreat (A) · 84 of 100 points: Model quality 31.4/45, Memory fit 24.0/25, Speed 14.2/15, Memory use 15.0/15 Gemma 4 12BGoogle Q3_K_M 7.5 GB 36.1 tok/s Tight fit
84 ptsGreat (A) · 84 of 100 points: Model quality 29.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 E4BGoogle Q4_K_M 6.0 GB 41.7 tok/s Runs well
83 ptsGreat (A) · 83 of 100 points: Model quality 29.9/45, Memory fit 24.0/25, Speed 14.1/15, Memory use 15.0/15 UI-Mate 9BTencent Q4_K_M 7.0 GB 35.5 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 29.9/45, Memory fit 24.0/25, Speed 14.1/15, Memory use 15.0/15 UI-Venus 2 9BAnt Group (inclusionAI) Q4_K_M 7.0 GB 35.5 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 29.1/45, Memory fit 24.0/25, Speed 14.6/15, Memory use 15.0/15 Granite 4.2 8BIBM Q4_K_M 7.7 GB 38.0 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 27.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 E2BGoogle Q6_K 5.3 GB 45.2 tok/s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 TMax 4BAi2 Q8_0 5.7 GB 40.4 tok/s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.7/15 Qwen3.5 4BAlibaba Q6_K 5.1 GB 49.7 tok/s Runs well

Best Image models for the NVIDIA GeForce RTX 4060

Grade · points Model Precision Memory Time per output Fit
84 ptsGreat (A) · 84 of 100 points: Model quality 34.7/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs Q8 GGUF 6.4 GB 4.3 s Runs well
84 ptsGreat (A) · 84 of 100 points: Model quality 35.2/45, Memory fit 20.0/25, Speed 14.1/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) Q4 GGUF 6.1 GB 11 s Runs well
80 ptsGreat (A) · 80 of 100 points: Model quality 25.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 DreamShaper XL v2 TurboLykon FP8 5.6 GB 4.2 s Runs well
79 ptsGreat (A) · 79 of 100 points: Model quality 27.3/45, Memory fit 25.0/25, Speed 12.5/15, Memory use 15.0/15 Juggernaut XL v9RunDiffusion FP8 5.6 GB 14 s Runs well
79 ptsGreat (A) · 79 of 100 points: Model quality 27.3/45, Memory fit 25.0/25, Speed 12.5/15, Memory use 15.0/15 RealVisXL V5.0SG161222 FP8 5.6 GB 14 s Runs well
79 ptsGreat (A) · 79 of 100 points: Model quality 37.4/45, Memory fit 12.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs Q8 GGUF 5.8 GB 9.6 s Runs well

Best Video models for the NVIDIA GeForce RTX 4060

Grade · points Model Precision Memory Time per output Fit
72 ptsGreat (A) · 72 of 100 points: Model quality 22.1/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 2BLightricks FP8 6.1 GB 85 s Runs well
69 ptsGood (B) · 69 of 100 points: Model quality 15.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.6/15 AnimateDiff v3 (SD 1.5)Shanghai AI Lab FP16 4.7 GB 72 s Runs well
68 ptsGood (B) · 68 of 100 points: Model quality 19.8/45, Memory fit 20.0/25, Speed 14.1/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP8 6.2 GB 3.4 min Runs well
64 ptsGood (B) · 64 of 100 points: Model quality 24.3/45, Memory fit 18.0/25, Speed 7.1/15, Memory use 15.0/15 Wan 2.1 T2V 1.3BAlibaba FP8 7.1 GB 13.5 min Tight fit
58 ptsGood (B) · 58 of 100 points: Model quality 24.3/45, Memory fit 12.0/25, Speed 7.3/15, Memory use 15.0/15 CogVideoX 5BZhipu AI FP8 5.9 GB 12.6 min Runs well

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.