Hardware · AMD

What AI models can the AMD Radeon PRO W6800 run?

VRAM
32.0 GB
Usable for models
32.0 GB
Memory bandwidth
512 GB/s
FP16 compute
35.7 TFLOPS
Released
2021
Launch price
$2,249

Specifications

MakerAMD
TypeWorkstation / datacenter graphics card
Video memory (VRAM)32.0 GB
Usable for AI models32.0 GB
Memory bandwidth512 GB/s
FP16 compute35.7 TFLOPS
InterfacePCIe 4.0
Released2021
Launch price (US)$2,249

Best LLMs for the AMD Radeon PRO W6800

Grade · points Model Quant Memory Speed Fit
96 ptsExcellent (S) · 96 of 100 points: Model quality 41.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Gemma 4 26B-A4BGoogle Q6_K 23.8 GB 49.4 tok/s Runs well
95 ptsExcellent (S) · 95 of 100 points: Model quality 41.7/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.6 35B-A3BAlibaba Q6_K 31.8 GB 62.6 tok/s Tight fit
95 ptsExcellent (S) · 95 of 100 points: Model quality 41.4/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen3.5 35B-A3BAlibaba Q6_K 31.8 GB 62.6 tok/s Tight fit
94 ptsExcellent (S) · 94 of 100 points: Model quality 40.1/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.5 35B-A3BDeepReinforce Q6_K 31.8 GB 62.6 tok/s Tight fit
93 ptsExcellent (S) · 93 of 100 points: Model quality 39.6/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Apodex 1.1 Mini (35B-A3B)Apodex Q6_K 31.8 GB 62.6 tok/s Tight fit
93 ptsExcellent (S) · 93 of 100 points: Model quality 39.6/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Ornith 1.0 35B-A3BDeepReinforce Q6_K 31.8 GB 62.6 tok/s Tight fit
93 ptsExcellent (S) · 93 of 100 points: Model quality 38.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 GLM-4.7 Flash (30B-A3B)Zhipu AI Q5_K_M 24.8 GB 74.5 tok/s Runs well
92 ptsExcellent (S) · 92 of 100 points: Model quality 38.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Qwen AgentWorld 35B-A3BAlibaba Q5_K_M 27.0 GB 74.5 tok/s Runs well
92 ptsExcellent (S) · 92 of 100 points: Model quality 38.8/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Agents-A1 35B-A3BInternScience Q6_K 31.2 GB 62.6 tok/s Tight fit
90 ptsExcellent (S) · 90 of 100 points: Model quality 40.9/45, Memory fit 25.0/25, Speed 10.5/15, Memory use 14.2/15 Qwen3.8 27BAlibaba Q4_K_M 19.7 GB 19.5 tok/s Runs well
90 ptsExcellent (S) · 90 of 100 points: Model quality 36.5/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15 Laguna XS 2.1 (33B-A3B)Poolside Q6_K 31.0 GB 62.6 tok/s Tight fit
89 ptsExcellent (S) · 89 of 100 points: Model quality 34.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Nemotron Cascade 2 30B-A3BNVIDIA Q5_K_M 24.7 GB 63.9 tok/s Runs well

Best Image models for the AMD Radeon PRO W6800

Grade · points Model Precision Memory Time per output Fit
92 ptsExcellent (S) · 92 of 100 points: Model quality 37.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15 Z-Image TurboAlibaba (Tongyi) FP16 22.7 GB 7.0 s Runs well
92 ptsExcellent (S) · 92 of 100 points: Model quality 37.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.8/15 FLUX.2 [klein] 9BBlack Forest Labs Q8 GGUF 20.5 GB 5.8 s Runs well
88 ptsExcellent (S) · 88 of 100 points: Model quality 35.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.0/15 FLUX.2 [klein] 4BBlack Forest Labs FP16 18.1 GB 2.8 s Runs well
85 ptsExcellent (S) · 85 of 100 points: Model quality 31.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.7/15 FLUX.1 [schnell]Black Forest Labs Q8 GGUF 20.4 GB 6.5 s Runs well
83 ptsGreat (A) · 83 of 100 points: Model quality 36.2/45, Memory fit 25.0/25, Speed 8.6/15, Memory use 14.1/15 FLUX.1 Krea [dev]Black Forest Labs FP8 19.6 GB 30 s Runs well
83 ptsGreat (A) · 83 of 100 points: Model quality 36.9/45, Memory fit 25.0/25, Speed 6.9/15, Memory use 15.0/15 Z-ImageAlibaba (Tongyi) FP16 22.7 GB 48 s Runs well

Best Video models for the AMD Radeon PRO W6800

Grade · points Model Precision Memory Time per output Fit
82 ptsGreat (A) · 82 of 100 points: Model quality 30.0/45, Memory fit 23.0/25, Speed 15.0/15, Memory use 15.0/15 LTX-Video 13B 0.9.8 (distilled)Lightricks FP8 30.1 GB 2.5 min Tight fit
76 ptsGreat (A) · 76 of 100 points: Model quality 32.6/45, Memory fit 23.0/25, Speed 6.3/15, Memory use 15.0/15 FramePack I2V (HunyuanVideo 13B)lllyasviel FP8 28.2 GB 16.9 min Tight fit
76 ptsGreat (A) · 76 of 100 points: Model quality 32.6/45, Memory fit 25.0/25, Speed 4.2/15, Memory use 15.0/15 Wan 2.1 I2V 14B 480PAlibaba FP8 26.2 GB 38.0 min Runs well
76 ptsGreat (A) · 76 of 100 points: Model quality 36.0/45, Memory fit 20.0/25, Speed 5.3/15, Memory use 15.0/15 LTX-2.3Lightricks Q4 GGUF 24.5 GB 23.6 min Runs well
75 ptsGreat (A) · 75 of 100 points: Model quality 33.5/45, Memory fit 23.0/25, Speed 4.0/15, Memory use 15.0/15 Wan 2.2 S2V 14B (speech to video)Alibaba FP8 28.1 GB 42.2 min Tight fit

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.