Check my GPU

Hardware · NVIDIA

What AI models can the NVIDIA RTX A5500 run?

VRAM
24.0 GB
Usable for models
24.0 GB
Memory bandwidth
768 GB/s
FP16 compute
34.1 TFLOPS
Released
2022
Launch price
$2,500

Specifications

MakerNVIDIA
TypeWorkstation / datacenter graphics card
Video memory (VRAM)24.0 GB
Usable for AI models24.0 GB
Memory bandwidth768 GB/s
FP16 compute34.1 TFLOPS
InterfacePCIe 4.0
Released2022
Launch price (US)$2,500

Best LLMs for the NVIDIA RTX A5500

Grade · points Model Quant Memory Speed Fit
95 ptsExcellent (S) · 95 of 100 points: Model quality 41.2/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 26B-A4BGoogle Q6_K 23.4 GB 86.1 tok/s Tight fit
94 ptsExcellent (S) · 94 of 100 points: Model quality 40.9/45, Memory fit 25.0/25, Speed 13.8/15, Memory use 15.0/15 Qwen3.8 27BAlibaba Q4_K_M 19.3 GB 33.9 tok/s Runs well
94 ptsExcellent (S) · 94 of 100 points: Model quality 40.2/45, Memory fit 25.0/25, Speed 13.8/15, Memory use 15.0/15 Qwen3.6 27BAlibaba Q4_K_M 19.3 GB 33.9 tok/s Runs well
93 ptsExcellent (S) · 93 of 100 points: Model quality 40.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.6 35B-A3BAlibaba Q4_K_M 23.9 GB 157 tok/s Tight fit
93 ptsExcellent (S) · 93 of 100 points: Model quality 39.8/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.5 35B-A3BAlibaba Q4_K_M 23.9 GB 157 tok/s Tight fit
93 ptsExcellent (S) · 93 of 100 points: Model quality 39.8/45, Memory fit 25.0/25, Speed 13.8/15, Memory use 15.0/15 Qwen3.5 27BAlibaba Q4_K_M 19.3 GB 33.9 tok/s Runs well
92 ptsExcellent (S) · 92 of 100 points: Model quality 38.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.5 35B-A3BDeepReinforce Q4_K_M 23.9 GB 157 tok/s Tight fit
92 ptsExcellent (S) · 92 of 100 points: Model quality 38.5/45, Memory fit 25.0/25, Speed 13.9/15, Memory use 15.0/15 TMax 27BAi2 Q4_K_M 19.0 GB 34.5 tok/s Runs well
92 ptsExcellent (S) · 92 of 100 points: Model quality 38.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Apodex 1.1 Mini (35B-A3B)Apodex Q4_K_M 23.9 GB 157 tok/s Tight fit
92 ptsExcellent (S) · 92 of 100 points: Model quality 38.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.0 35B-A3BDeepReinforce Q4_K_M 23.9 GB 157 tok/s Tight fit
91 ptsExcellent (S) · 91 of 100 points: Model quality 37.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.6/15 Gemma 4 12BGoogle Q8_0 15.1 GB 40.1 tok/s Runs well
91 ptsExcellent (S) · 91 of 100 points: Model quality 37.6/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 GLM-4.7 Flash (30B-A3B)Zhipu AI Q4_K_M 21.3 GB 157 tok/s Tight fit

Best Image models for the NVIDIA RTX A5500

Grade · points Model Precision Memory Time per output Fit
92 ptsExcellent (S) · 92 of 100 points: Model quality 37.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs FP8 19.9 GB 3.1 s Runs well
90 ptsExcellent (S) · 90 of 100 points: Model quality 35.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs FP16 18.1 GB 1.9 s Runs well
89 ptsExcellent (S) · 89 of 100 points: Model quality 37.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.5/15 Z-Image TurboAlibaba (Tongyi) Q8 GGUF 13.0 GB 5.6 s Runs well
86 ptsExcellent (S) · 86 of 100 points: Model quality 36.2/45, Memory fit 25.0/25, Speed 10.4/15, Memory use 15.0/15 FLUX.1 Krea [dev]Black Forest Labs FP8 19.6 GB 21 s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 30.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 FLUX.1 [schnell]Black Forest Labs FP8 19.6 GB 3.5 s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 35.3/45, Memory fit 25.0/25, Speed 10.4/15, Memory use 15.0/15 FLUX.1 [dev]Black Forest Labs FP8 19.6 GB 21 s Runs well

Best Video models for the NVIDIA RTX A5500

Grade · points Model Precision Memory Time per output Fit
77 ptsGreat (A) · 77 of 100 points: Model quality 22.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 2BLightricks FP16 17.5 GB 49 s Runs well
75 ptsGreat (A) · 75 of 100 points: Model quality 20.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP16 17.5 GB 1.9 min Runs well
75 ptsGreat (A) · 75 of 100 points: Model quality 32.6/45, Memory fit 20.0/25, Speed 7.4/15, Memory use 15.0/15 FramePack I2V (HunyuanVideo 13B)lllyasviel FP8 19.6 GB 12.2 min Runs well
74 ptsGreat (A) · 74 of 100 points: Model quality 24.3/45, Memory fit 25.0/25, Speed 11.3/15, Memory use 14.3/15 CogVideoX 5B I2VZhipu AI FP8 14.9 GB 5.2 min Runs well
74 ptsGreat (A) · 74 of 100 points: Model quality 24.3/45, Memory fit 25.0/25, Speed 11.3/15, Memory use 13.8/15 CogVideoX 5BZhipu AI FP8 14.3 GB 5.2 min Runs well

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.