Check my GPU

Hardware · NVIDIA

What AI models can the NVIDIA A2 run?

VRAM
16.0 GB
Usable for models
16.0 GB
Memory bandwidth
200 GB/s
FP16 compute
4.5 TFLOPS
Released
2021

Specifications

MakerNVIDIA
TypeWorkstation / datacenter graphics card
Video memory (VRAM)16.0 GB
Usable for AI models16.0 GB
Memory bandwidth200 GB/s
FP16 compute4.5 TFLOPS
InterfacePCIe 4.0
Released2021

Best LLMs for the NVIDIA A2

Grade · points Model Quant Memory Speed Fit
88 ptsExcellent (S) · 88 of 100 points: Model quality 35.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 26B-A4BGoogle Q3_K_M 14.4 GB 41.8 tok/s Tight fit
85 ptsExcellent (S) · 85 of 100 points: Model quality 31.5/45, Memory fit 25.0/25, Speed 14.3/15, Memory use 15.0/15 gpt-oss 20BOpenAI MXFP4 13.5 GB 36.5 tok/s Runs well
84 ptsGreat (A) · 84 of 100 points: Model quality 35.5/45, Memory fit 25.0/25, Speed 10.7/15, Memory use 13.5/15 Gemma 4 12BGoogle Q4_K_M 9.4 GB 20.5 tok/s Runs well
83 ptsGreat (A) · 83 of 100 points: Model quality 29.9/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 ERNIE 4.5 21B-A3B ThinkingBaidu Q4_K_M 15.2 GB 40.9 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 29.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.6 35B-A3BAlibaba Q2_K 15.9 GB 67.2 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 29.5/45, Memory fit 24.0/25, Speed 14.9/15, Memory use 15.0/15 DiffusionGemma 26B-A4B ITGoogle Q3_K_M 14.5 GB 39.7 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 29.3/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.5 35B-A3BAlibaba Q2_K 15.9 GB 67.2 tok/s Tight fit
83 ptsGreat (A) · 83 of 100 points: Model quality 36.1/45, Memory fit 24.0/25, Speed 8.0/15, Memory use 15.0/15 Qwen3.8 27BAlibaba Q3_K_M 15.5 GB 11.4 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 35.5/45, Memory fit 24.0/25, Speed 8.0/15, Memory use 15.0/15 Qwen3.6 27BAlibaba Q3_K_M 15.5 GB 11.4 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 28.4/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.5 35B-A3BDeepReinforce Q2_K 15.9 GB 67.2 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 8.0/15, Memory use 15.0/15 Qwen3.5 27BAlibaba Q3_K_M 15.5 GB 11.4 tok/s Tight fit
82 ptsGreat (A) · 82 of 100 points: Model quality 28.0/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Apodex 1.1 Mini (35B-A3B)Apodex Q2_K 15.9 GB 67.2 tok/s Tight fit

Best Image models for the NVIDIA A2

Grade · points Model Precision Memory Time per output Fit
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.7/45, Memory fit 25.0/25, Speed 14.9/15, Memory use 15.0/15 FLUX.2 [klein] 4BBlack Forest Labs Q8 GGUF 10.5 GB 10 s Runs well
87 ptsExcellent (S) · 87 of 100 points: Model quality 37.0/45, Memory fit 25.0/25, Speed 10.6/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) FP8 12.6 GB 20 s Runs well
84 ptsGreat (A) · 84 of 100 points: Model quality 37.0/45, Memory fit 20.0/25, Speed 12.2/15, Memory use 15.0/15 FLUX.2 [klein] 9BBlack Forest Labs FP8 11.7 GB 15 s Runs well
80 ptsGreat (A) · 80 of 100 points: Model quality 36.2/45, Memory fit 25.0/25, Speed 4.1/15, Memory use 15.0/15 Z-ImageAlibaba (Tongyi) FP8 12.6 GB 2.3 min Runs well
78 ptsGreat (A) · 78 of 100 points: Model quality 29.3/45, Memory fit 23.0/25, Speed 10.7/15, Memory use 15.0/15 FLUX.1 [schnell]Black Forest Labs NF4 14.4 GB 20 s Tight fit
77 ptsGreat (A) · 77 of 100 points: Model quality 25.9/45, Memory fit 25.0/25, Speed 11.5/15, Memory use 15.0/15 Stable Diffusion 3.5 Large TurboStability AI Q4 GGUF 13.0 GB 17 s Runs well

Best Video models for the NVIDIA A2

Grade · points Model Precision Memory Time per output Fit
76 ptsGreat (A) · 76 of 100 points: Model quality 22.1/45, Memory fit 25.0/25, Speed 14.2/15, Memory use 15.0/15 LTX-Video 2BLightricks FP8 10.8 GB 3.3 min Runs well
69 ptsGood (B) · 69 of 100 points: Model quality 19.8/45, Memory fit 25.0/25, Speed 9.2/15, Memory use 15.0/15 CogVideoX 2BZhipu AI FP8 11.0 GB 8.0 min Runs well
68 ptsGood (B) · 68 of 100 points: Model quality 24.3/45, Memory fit 25.0/25, Speed 4.6/15, Memory use 15.0/15 Wan 2.1 T2V 1.3BAlibaba FP8 12.8 GB 31.9 min Runs well
67 ptsGood (B) · 67 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 5.3/15, Memory use 15.0/15 CogVideoX 5BZhipu AI FP8 14.3 GB 23.9 min Tight fit
67 ptsGood (B) · 67 of 100 points: Model quality 24.3/45, Memory fit 23.0/25, Speed 5.3/15, Memory use 15.0/15 CogVideoX 5B I2VZhipu AI FP8 14.9 GB 23.9 min Tight fit

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.