Check my GPU

Hardware · NVIDIA

What AI models can the NVIDIA RTX 2000 Ada Generation Laptop GPU run?

VRAM
8.0 GB
Usable for models
8.0 GB
Memory bandwidth
256 GB/s
FP16 compute
14.5 TFLOPS
Released
2023

Specifications

MakerNVIDIA
TypeLaptop GPU (soldered memory)
Video memory (VRAM)8.0 GB
Usable for AI models8.0 GB
Memory bandwidth256 GB/s
FP16 compute14.5 TFLOPS
InterfacePCIe 4.0
Released2023

Best LLMs for the NVIDIA RTX 2000 Ada Generation Laptop GPU

Grade · points Model Quant Memory Speed Fit
85 ptsExcellent (S) · 85 of 100 points: Model quality 31.6/45, Memory fit 25.0/25, Speed 14.1/15, Memory use 15.0/15 TMax 9BAi2 Q4_K_M 6.7 GB 35.1 tok/s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 32.9/45, Memory fit 24.0/25, Speed 13.5/15, Memory use 15.0/15 Ornith 1.5 9BDeepReinforce Q4_K_M 7.2 GB 32.6 tok/s Tight fit
85 ptsExcellent (S) · 85 of 100 points: Model quality 32.5/45, Memory fit 24.0/25, Speed 13.5/15, Memory use 15.0/15 Qwen3.5 9BAlibaba Q4_K_M 7.2 GB 32.6 tok/s Tight fit
84 ptsGreat (A) · 84 of 100 points: Model quality 32.1/45, Memory fit 24.0/25, Speed 13.5/15, Memory use 15.0/15 Ornith 1.0 9BDeepReinforce Q4_K_M 7.2 GB 32.6 tok/s Tight fit
84 ptsGreat (A) · 84 of 100 points: Model quality 31.4/45, Memory fit 24.0/25, Speed 13.8/15, Memory use 15.0/15 Gemma 4 12BGoogle Q3_K_M 7.5 GB 34.0 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 29.1/45, Memory fit 25.0/25, Speed 14.9/15, Memory use 15.0/15 Gemma 4 E4BGoogle Q4_K_M 6.0 GB 39.3 tok/s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 29.9/45, Memory fit 24.0/25, Speed 13.7/15, Memory use 15.0/15 UI-Mate 9BTencent Q4_K_M 7.0 GB 33.4 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 29.9/45, Memory fit 24.0/25, Speed 13.7/15, Memory use 15.0/15 UI-Venus 2 9BAnt Group (inclusionAI) Q4_K_M 7.0 GB 33.4 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 27.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 E2BGoogle Q6_K 5.3 GB 42.6 tok/s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 27.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.7/15 Qwen3.5 4BAlibaba Q6_K 5.1 GB 46.8 tok/s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 29.1/45, Memory fit 24.0/25, Speed 14.2/15, Memory use 15.0/15 Granite 4.2 8BIBM Q4_K_M 7.7 GB 35.8 tok/s Tight fit
81 ptsGreat (A) · 81 of 100 points: Model quality 26.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.4/15 Agents-A1 4BInternScience Q6_K 5.0 GB 48.0 tok/s Runs well

Best Image models for the NVIDIA RTX 2000 Ada Generation Laptop GPU

Grade · points Model Precision Memory Time per output Fit
84 ptsGreat (A) · 84 of 100 points: Model quality 34.7/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs Q8 GGUF 6.4 GB 4.5 s Runs well
84 ptsGreat (A) · 84 of 100 points: Model quality 35.2/45, Memory fit 20.0/25, Speed 13.9/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) Q4 GGUF 6.1 GB 12 s Runs well
80 ptsGreat (A) · 80 of 100 points: Model quality 25.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 DreamShaper XL v2 TurboLykon FP8 5.6 GB 4.3 s Runs well
79 ptsGreat (A) · 79 of 100 points: Model quality 27.3/45, Memory fit 25.0/25, Speed 12.3/15, Memory use 15.0/15 Juggernaut XL v9RunDiffusion FP8 5.6 GB 15 s Runs well
79 ptsGreat (A) · 79 of 100 points: Model quality 27.3/45, Memory fit 25.0/25, Speed 12.3/15, Memory use 15.0/15 RealVisXL V5.0SG161222 FP8 5.6 GB 15 s Runs well
79 ptsGreat (A) · 79 of 100 points: Model quality 37.4/45, Memory fit 12.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs Q8 GGUF 5.8 GB 9.9 s Runs well

Best Video models for the NVIDIA RTX 2000 Ada Generation Laptop GPU

Grade · points Model Precision Memory Time per output Fit
72 ptsGreat (A) · 72 of 100 points: Model quality 22.1/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 2BLightricks FP8 6.1 GB 87 s Runs well
69 ptsGood (B) · 69 of 100 points: Model quality 15.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.6/15 AnimateDiff v3 (SD 1.5)Shanghai AI Lab FP16 4.7 GB 74 s Runs well
68 ptsGood (B) · 68 of 100 points: Model quality 19.8/45, Memory fit 20.0/25, Speed 13.9/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP8 6.2 GB 3.5 min Runs well
64 ptsGood (B) · 64 of 100 points: Model quality 24.3/45, Memory fit 18.0/25, Speed 7.0/15, Memory use 15.0/15 Wan 2.1 T2V 1.3BAlibaba FP8 7.1 GB 13.9 min Tight fit
58 ptsGood (B) · 58 of 100 points: Model quality 24.3/45, Memory fit 12.0/25, Speed 7.2/15, Memory use 15.0/15 CogVideoX 5BZhipu AI FP8 5.9 GB 12.9 min Runs well

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.