Check my GPU

Hardware · NVIDIA

What AI models can the NVIDIA RTX 5000 Ada Generation Laptop GPU run?

VRAM
16.0 GB
Usable for models
16.0 GB
Memory bandwidth
576 GB/s
FP16 compute
42.6 TFLOPS
Released
2023

Specifications

MakerNVIDIA
TypeLaptop GPU (soldered memory)
Video memory (VRAM)16.0 GB
Usable for AI models16.0 GB
Memory bandwidth576 GB/s
FP16 compute42.6 TFLOPS
InterfacePCIe 4.0
Released2023

Best LLMs for the NVIDIA RTX 5000 Ada Generation Laptop GPU

Grade · points Model Quant Memory Speed Fit
91 ptsExcellent (S) · 91 of 100 points: Model quality 37.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 12BGoogle Q6_K 11.9 GB 41.0 tok/s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 35.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 26B-A4BGoogle Q3_K_M 14.4 GB 120 tok/s Tight fit
88 ptsExcellent (S) · 88 of 100 points: Model quality 36.1/45, Memory fit 24.0/25, Speed 13.6/15, Memory use 15.0/15 Qwen3.8 27BAlibaba Q3_K_M 15.5 GB 32.9 tok/s Tight fit
88 ptsExcellent (S) · 88 of 100 points: Model quality 33.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 TMax 9BAi2 Q8_0 11.2 GB 40.2 tok/s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 35.5/45, Memory fit 24.0/25, Speed 13.6/15, Memory use 15.0/15 Qwen3.6 27BAlibaba Q3_K_M 15.5 GB 32.9 tok/s Tight fit
88 ptsExcellent (S) · 88 of 100 points: Model quality 34.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.8/15 Ornith 1.5 9BDeepReinforce Q6_K 9.6 GB 50.8 tok/s Runs well
87 ptsExcellent (S) · 87 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 13.6/15, Memory use 15.0/15 Qwen3.5 27BAlibaba Q3_K_M 15.5 GB 32.9 tok/s Tight fit
87 ptsExcellent (S) · 87 of 100 points: Model quality 33.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.8/15 Qwen3.5 9BAlibaba Q6_K 9.6 GB 50.8 tok/s Runs well
87 ptsExcellent (S) · 87 of 100 points: Model quality 33.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.8/15 Ornith 1.0 9BDeepReinforce Q6_K 9.6 GB 50.8 tok/s Runs well
86 ptsExcellent (S) · 86 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 13.7/15, Memory use 15.0/15 TMax 27BAi2 Q3_K_M 15.3 GB 33.4 tok/s Tight fit
86 ptsExcellent (S) · 86 of 100 points: Model quality 31.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 gpt-oss 20BOpenAI MXFP4 13.5 GB 105 tok/s Runs well
86 ptsExcellent (S) · 86 of 100 points: Model quality 31.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Phi-4 Reasoning Plus (14B)Microsoft Q5_K_M 13.5 GB 39.8 tok/s Runs well

Best Image models for the NVIDIA RTX 5000 Ada Generation Laptop GPU

Grade · points Model Precision Memory Time per output Fit
92 ptsExcellent (S) · 92 of 100 points: Model quality 37.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) Q8 GGUF 13.0 GB 4.7 s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs Q8 GGUF 10.5 GB 1.9 s Runs well
87 ptsExcellent (S) · 87 of 100 points: Model quality 37.4/45, Memory fit 20.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs Q8 GGUF 12.3 GB 3.6 s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 36.2/45, Memory fit 25.0/25, Speed 9.5/15, Memory use 15.0/15 Z-ImageAlibaba (Tongyi) FP8 12.6 GB 25 s Runs well
82 ptsGreat (A) · 82 of 100 points: Model quality 29.3/45, Memory fit 23.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.1 [schnell]Black Forest Labs Q4 GGUF 14.8 GB 3.9 s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 34.3/45, Memory fit 23.0/25, Speed 9.8/15, Memory use 15.0/15 FLUX.1 Krea [dev]Black Forest Labs Q4 GGUF 14.8 GB 24 s Tight fit

Best Video models for the NVIDIA RTX 5000 Ada Generation Laptop GPU

Grade · points Model Precision Memory Time per output Fit
77 ptsGreat (A) · 77 of 100 points: Model quality 22.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 2BLightricks FP8 10.8 GB 37 s Runs well
74 ptsGreat (A) · 74 of 100 points: Model quality 24.3/45, Memory fit 25.0/25, Speed 10.7/15, Memory use 15.0/15 Wan 2.1 T2V 1.3BAlibaba FP8 12.8 GB 5.9 min Runs well
74 ptsGreat (A) · 74 of 100 points: Model quality 19.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP8 11.0 GB 89 s Runs well
74 ptsGreat (A) · 74 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 12.3/15, Memory use 15.0/15 CogVideoX 5BZhipu AI FP8 14.3 GB 4.4 min Tight fit
74 ptsGreat (A) · 74 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 12.3/15, Memory use 15.0/15 CogVideoX 5B I2VZhipu AI FP8 14.9 GB 4.4 min Tight fit

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.