Check my GPU

What your Apple M2 (8 GB) can run

We check your graphics card or Mac against every model in the catalog. Your browser reports the GPU model but not its memory, so confirm the exact version below.

Unified memory
8.0 GB
Usable for models
5.4 GB
Memory bandwidth
100 GB/s
FP16 compute
3.6 TFLOPS
250 / 536 LLMs run Best: TMax 4B (A) 37 / 47 Image models run Best: FLUX.2 [klein] 4B (A) 3 / 34 Video models run Best: AnimateDiff v3 (SD 1.5) (B)

Open in Model Finder Best LLMs by task Compare with another GPU

LLMs on your Apple M2 (8 GB)

Grade · points Model Quant Memory Speed Fit
77 ptsGreat (A) · 77 of 100 points: Model quality 26.1/45, Memory fit 25.0/25, Speed 11.9/15, Memory use 15.0/15TMax 4BAi2 · 4.2BQ4_K_M3.9 GB25.1 tok/sRuns well
77 ptsGreat (A) · 77 of 100 points: Model quality 26.5/45, Memory fit 25.0/25, Speed 11.3/15, Memory use 15.0/15Qwen3.5 4BAlibaba · 4.7BQ4_K_M4.1 GB22.7 tok/sRuns well
77 ptsGreat (A) · 77 of 100 points: Model quality 26.5/45, Memory fit 25.0/25, Speed 10.8/15, Memory use 15.0/15Gemma 4 E2BGoogle · 5.1BQ4_K_M4.2 GB20.6 tok/sRuns well
77 ptsGreat (A) · 77 of 100 points: Model quality 25.7/45, Memory fit 25.0/25, Speed 11.4/15, Memory use 15.0/15Agents-A1 4BInternScience · 4.5BQ4_K_M4.1 GB23.3 tok/sRuns well
76 ptsGreat (A) · 76 of 100 points: Model quality 22.7/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15Ling 3.0 Tiny (8B-A1.3B)Ant Group (inclusionAI) · 7.9B (1.3B active)Q3_K_M5.1 GB52.6 tok/sTight fit
76 ptsGreat (A) · 76 of 100 points: Model quality 24.8/45, Memory fit 25.0/25, Speed 11.4/15, Memory use 15.0/15Fara 1.5 4BMicrosoft · 4.5BQ4_K_M4.1 GB23.3 tok/sRuns well
75 ptsGreat (A) · 75 of 100 points: Model quality 23.9/45, Memory fit 24.0/25, Speed 12.2/15, Memory use 15.0/15Qwen3 4B Thinking 2507Alibaba · 4.0BQ4_K_M4.7 GB26.3 tok/sTight fit
74 ptsGreat (A) · 74 of 100 points: Model quality 22.2/45, Memory fit 25.0/25, Speed 12.7/15, Memory use 15.0/15Granite 4.2 3BIBM · 3.7BQ4_K_M3.9 GB28.9 tok/sRuns well
74 ptsGreat (A) · 74 of 100 points: Model quality 25.7/45, Memory fit 24.0/25, Speed 9.8/15, Memory use 15.0/15Gemma 4 E4BGoogle · 8.0BQ3_K_M5.1 GB17.1 tok/sTight fit
74 ptsGreat (A) · 74 of 100 points: Model quality 23.1/45, Memory fit 24.0/25, Speed 12.2/15, Memory use 15.0/15Qwen3 4B Instruct 2507Alibaba · 4.0BQ4_K_M4.7 GB26.3 tok/sTight fit
74 ptsGreat (A) · 74 of 100 points: Model quality 23.9/45, Memory fit 24.0/25, Speed 11.2/15, Memory use 15.0/15Mage-VL 4.7BMicrosoft · 4.7BQ4_K_M5.1 GB22.3 tok/sTight fit
73 ptsGreat (A) · 73 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15North Micro VisionCohere · 2.5BQ4_K_M3.5 GB42.6 tok/sRuns well
73 ptsGreat (A) · 73 of 100 points: Model quality 23.1/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Qwen3-VL 4B InstructAlibaba · 4.4BQ4_K_M4.9 GB23.8 tok/sTight fit
73 ptsGreat (A) · 73 of 100 points: Model quality 19.7/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15LFM2.5 8B-A1BLiquid AI · 8.5B (1.5B active)Q3_K_M5.3 GB45.6 tok/sTight fit
73 ptsGreat (A) · 73 of 100 points: Model quality 21.4/45, Memory fit 25.0/25, Speed 12.2/15, Memory use 15.0/15Nemotron 3 Nano 4BNVIDIA · 4.0BQ4_K_M3.6 GB26.6 tok/sRuns well
73 ptsGreat (A) · 73 of 100 points: Model quality 24.3/45, Memory fit 24.0/25, Speed 10.1/15, Memory use 15.0/15Ornith 1.5 9BDeepReinforce · 9.7BQ2_K5.2 GB18.0 tok/sTight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 23.9/45, Memory fit 24.0/25, Speed 10.1/15, Memory use 15.0/15Qwen3.5 9BAlibaba · 9.7BQ2_K5.2 GB18.0 tok/sTight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 19.7/45, Memory fit 25.0/25, Speed 13.2/15, Memory use 15.0/15Granite 4.1 3BIBM · 3.4BQ4_K_M3.8 GB31.1 tok/sRuns well
72 ptsGreat (A) · 72 of 100 points: Model quality 17.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15Unlimited OCR (3B-A0.6B)Baidu · 3.3B (0.6B active)Q6_K4.3 GB61.1 tok/sRuns well
72 ptsGreat (A) · 72 of 100 points: Model quality 18.8/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15Granite 4.0 H Tiny (7B-A1B)IBM · 6.9B (1.0B active)Q4_K_M5.3 GB52.9 tok/sTight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 23.3/45, Memory fit 24.0/25, Speed 10.4/15, Memory use 15.0/15TMax 9BAi2 · 9.0BQ2_K4.9 GB19.4 tok/sTight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 18.9/45, Memory fit 25.0/25, Speed 13.8/15, Memory use 15.0/15Qwen3 4BAlibaba · 4.0BQ3_K_M4.2 GB34.0 tok/sRuns well
72 ptsGreat (A) · 72 of 100 points: Model quality 23.6/45, Memory fit 24.0/25, Speed 10.1/15, Memory use 15.0/15Ornith 1.0 9BDeepReinforce · 9.7BQ2_K5.2 GB18.0 tok/sTight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 19.7/45, Memory fit 25.0/25, Speed 12.4/15, Memory use 15.0/15Phi-4 Mini Reasoning (3.8B)Microsoft · 3.8BQ4_K_M4.4 GB27.5 tok/sRuns well
71 ptsGood (B) · 71 of 100 points: Model quality 18.0/45, Memory fit 25.0/25, Speed 13.9/15, Memory use 15.0/15SmolLM3 3BHugging Face · 3.1BQ4_K_M3.5 GB34.3 tok/sRuns well
71 ptsGood (B) · 71 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 12.4/15, Memory use 15.0/15Phi-4 Mini (3.8B)Microsoft · 3.8BQ4_K_M4.4 GB27.5 tok/sRuns well
71 ptsGood (B) · 71 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 12.4/15, Memory use 15.0/15Ministral 3 3BMistral AI · 3.9BQ4_K_M4.2 GB27.5 tok/sRuns well
71 ptsGood (B) · 71 of 100 points: Model quality 22.1/45, Memory fit 24.0/25, Speed 10.2/15, Memory use 15.0/15UI-Mate 9BTencent · 9.4BQ2_K5.1 GB18.4 tok/sTight fit
71 ptsGood (B) · 71 of 100 points: Model quality 22.1/45, Memory fit 24.0/25, Speed 10.2/15, Memory use 15.0/15UI-Venus 2 9BAnt Group (inclusionAI) · 9.4BQ2_K5.1 GB18.4 tok/sTight fit
70 ptsGood (B) · 70 of 100 points: Model quality 19.2/45, Memory fit 25.0/25, Speed 11.8/15, Memory use 15.0/15Gemma 3 4B ITGoogle · 4.3BQ4_K_M3.9 GB24.6 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 13.8/15, Memory use 13.2/15LFM2.5-VL 3BLiquid AI · 3.1BQ4_K_M3.1 GB33.9 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 14.8/15, Memory use 12.1/15LFM2.5 2.6BLiquid AI · 2.7BQ4_K_M2.8 GB39.1 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 15.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15Qwen3-VL 2B InstructAlibaba · 2.1BQ5_K_M3.5 GB41.0 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 11.8/15, Memory use 15.0/15MedGemma 4B ITGoogle · 4.3BQ4_K_M3.9 GB24.6 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 17.1/45, Memory fit 25.0/25, Speed 13.2/15, Memory use 15.0/15Granite 4.0 Micro (3B)IBM · 3.4BQ4_K_M3.8 GB31.1 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 18.8/45, Memory fit 25.0/25, Speed 13.6/15, Memory use 12.9/15Jamba Reasoning 3BAI21 Labs · 3.2BQ4_K_M3.0 GB33.0 tok/sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 21.2/45, Memory fit 24.0/25, Speed 10.1/15, Memory use 15.0/15Falcon-H1R 7BTII · 7.6BQ3_K_M5.1 GB18.0 tok/sTight fit
69 ptsGood (B) · 69 of 100 points: Model quality 20.8/45, Memory fit 24.0/25, Speed 10.0/15, Memory use 15.0/15Qwen2.5 Coder 7B InstructAlibaba · 7.6BQ3_K_M5.2 GB17.9 tok/sTight fit
69 ptsGood (B) · 69 of 100 points: Model quality 16.6/45, Memory fit 25.0/25, Speed 13.1/15, Memory use 15.0/15Llama 3.1 Nemotron Nano 4B v1.1NVIDIA · 4.5BQ3_K_M4.3 GB30.3 tok/sRuns well
69 ptsGood (B) · 69 of 100 points: Model quality 20.4/45, Memory fit 24.0/25, Speed 10.0/15, Memory use 15.0/15OpenReasoning Nemotron 7BNVIDIA · 7.6BQ3_K_M5.2 GB17.9 tok/sTight fit
69 ptsGood (B) · 69 of 100 points: Model quality 18.0/45, Memory fit 25.0/25, Speed 14.0/15, Memory use 12.4/15Jamba2 3BAI21 Labs · 3.0BQ4_K_M2.9 GB34.9 tok/sRuns well
69 ptsGood (B) · 69 of 100 points: Model quality 15.9/45, Memory fit 25.0/25, Speed 13.5/15, Memory use 15.0/15Hunyuan 4B InstructTencent · 4.2BQ3_K_M4.3 GB32.4 tok/sRuns well
69 ptsGood (B) · 69 of 100 points: Model quality 17.8/45, Memory fit 25.0/25, Speed 14.8/15, Memory use 11.5/15TMax 2BAi2 · 1.9BQ6_K2.7 GB39.0 tok/sRuns well
69 ptsGood (B) · 69 of 100 points: Model quality 20.4/45, Memory fit 24.0/25, Speed 9.7/15, Memory use 15.0/15MiniCPM4 8BOpenBMB · 8.2BQ3_K_M5.3 GB16.7 tok/sTight fit
68 ptsGood (B) · 68 of 100 points: Model quality 17.5/45, Memory fit 25.0/25, Speed 14.7/15, Memory use 11.8/15Qwen3.5 2BAlibaba · 2.3BQ5_K_M2.7 GB38.5 tok/sRuns well
68 ptsGood (B) · 68 of 100 points: Model quality 19.7/45, Memory fit 24.0/25, Speed 10.0/15, Memory use 15.0/15Qwen2.5 7B InstructAlibaba · 7.6BQ3_K_M5.2 GB17.9 tok/sTight fit
68 ptsGood (B) · 68 of 100 points: Model quality 15.0/45, Memory fit 25.0/25, Speed 13.6/15, Memory use 15.0/15Llama 3.2 3B InstructMeta · 3.2BQ4_K_M3.9 GB32.9 tok/sRuns well
68 ptsGood (B) · 68 of 100 points: Model quality 17.1/45, Memory fit 25.0/25, Speed 11.3/15, Memory use 15.0/15AFM 4.5BArcee AI · 4.6BQ4_K_M4.5 GB22.9 tok/sRuns well
68 ptsGood (B) · 68 of 100 points: Model quality 18.9/45, Memory fit 24.0/25, Speed 10.5/15, Memory use 15.0/15Nemotron Nano 9B v2NVIDIA · 8.9BQ2_K4.7 GB19.5 tok/sTight fit
68 ptsGood (B) · 68 of 100 points: Model quality 14.4/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15LFM2 8B-A1BLiquid AI · 8.3B (1.5B active)Q3_K_M5.2 GB45.6 tok/sTight fit
68 ptsGood (B) · 68 of 100 points: Model quality 16.2/45, Memory fit 25.0/25, Speed 12.1/15, Memory use 15.0/15MiniCPM3 4BOpenBMB · 4.1BQ4_K_M3.8 GB26.0 tok/sRuns well
68 ptsGood (B) · 68 of 100 points: Model quality 15.4/45, Memory fit 25.0/25, Speed 13.9/15, Memory use 13.8/15Qwen2.5 Coder 3B InstructAlibaba · 3.1BQ4_K_M3.2 GB34.2 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 16.2/45, Memory fit 25.0/25, Speed 13.7/15, Memory use 13.1/15Granite 4.0 H MicroIBM · 3.2BQ4_K_M3.0 GB33.1 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 15.4/45, Memory fit 25.0/25, Speed 13.7/15, Memory use 13.9/15Falcon-H1 3B InstructTII · 3.2BQ4_K_M3.2 GB33.6 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 18.9/45, Memory fit 24.0/25, Speed 10.1/15, Memory use 15.0/15Falcon-H1 7B InstructTII · 7.6BQ3_K_M5.1 GB18.0 tok/sTight fit
67 ptsGood (B) · 67 of 100 points: Model quality 18.9/45, Memory fit 24.0/25, Speed 10.0/15, Memory use 15.0/15Qwen2.5 7B Instruct 1MAlibaba · 7.6BQ3_K_M5.2 GB17.9 tok/sTight fit
67 ptsGood (B) · 67 of 100 points: Model quality 17.6/45, Memory fit 24.0/25, Speed 11.2/15, Memory use 15.0/15EXAONE Deep 7.8BLG AI Research · 7.8BQ2_K5.2 GB22.2 tok/sTight fit
67 ptsGood (B) · 67 of 100 points: Model quality 13.6/45, Memory fit 25.0/25, Speed 14.2/15, Memory use 15.0/15Phi-3 Mini 4K InstructMicrosoft · 3.8BQ3_K_M4.5 GB35.8 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 13.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.7/15Qwen3 1.7BAlibaba · 2.0BQ5_K_M3.4 GB43.0 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 17.6/45, Memory fit 24.0/25, Speed 11.1/15, Memory use 15.0/15InternVL3 8BShanghai AI Lab · 7.9BQ2_K4.7 GB21.9 tok/sTight fit
67 ptsGood (B) · 67 of 100 points: Model quality 18.3/45, Memory fit 24.0/25, Speed 10.2/15, Memory use 15.0/15GLM-Z1 9B (0414)Zhipu AI · 9.4BQ2_K5.1 GB18.5 tok/sTight fit
67 ptsGood (B) · 67 of 100 points: Model quality 16.6/45, Memory fit 24.0/25, Speed 11.7/15, Memory use 15.0/15Phi-4 Multimodal InstructMicrosoft · 5.6BQ3_K_M4.8 GB24.5 tok/sTight fit
67 ptsGood (B) · 67 of 100 points: Model quality 13.7/45, Memory fit 25.0/25, Speed 13.6/15, Memory use 15.0/15Hermes 3 Llama 3.2 3BNous Research · 3.2BQ4_K_M3.9 GB32.9 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 14.5/45, Memory fit 25.0/25, Speed 13.9/15, Memory use 13.8/15Qwen2.5 3B InstructAlibaba · 3.1BQ4_K_M3.2 GB34.2 tok/sRuns well
67 ptsGood (B) · 67 of 100 points: Model quality 17.0/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Llama 3.1 Nemotron Nano 8B v1NVIDIA · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
66 ptsGood (B) · 66 of 100 points: Model quality 16.4/45, Memory fit 24.0/25, Speed 11.4/15, Memory use 15.0/15Hunyuan 7B InstructTencent · 7.5BQ2_K5.1 GB23.1 tok/sTight fit
66 ptsGood (B) · 66 of 100 points: Model quality 12.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.0/15Granite 3.2 2B InstructIBM · 2.5BQ4_K_M3.2 GB41.8 tok/sRuns well
66 ptsGood (B) · 66 of 100 points: Model quality 12.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.0/15Granite 3.3 2BIBM · 2.5BQ4_K_M3.2 GB41.8 tok/sRuns well
66 ptsGood (B) · 66 of 100 points: Model quality 17.4/45, Memory fit 24.0/25, Speed 10.0/15, Memory use 15.0/15DeepSeek R1 Distill Qwen 7BDeepSeek · 7.6BQ3_K_M5.2 GB17.9 tok/sTight fit
66 ptsGood (B) · 66 of 100 points: Model quality 13.6/45, Memory fit 25.0/25, Speed 12.8/15, Memory use 15.0/15Voxtral Mini 3BMistral AI · 4.7BQ3_K_M4.3 GB29.2 tok/sRuns well
66 ptsGood (B) · 66 of 100 points: Model quality 12.8/45, Memory fit 25.0/25, Speed 13.6/15, Memory use 15.0/15Falcon 3 3B InstructTII · 3.2BQ4_K_M3.7 GB32.7 tok/sRuns well
66 ptsGood (B) · 66 of 100 points: Model quality 12.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.5/15EXAONE 3.5 2.4BLG AI Research · 2.4BQ4_K_M3.1 GB43.9 tok/sRuns well
66 ptsGood (B) · 66 of 100 points: Model quality 14.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.8/15LFM2 2.6BLiquid AI · 2.6BQ4_K_M2.7 GB41.1 tok/sRuns well
66 ptsGood (B) · 66 of 100 points: Model quality 17.4/45, Memory fit 24.0/25, Speed 9.9/15, Memory use 15.0/15Gemma 3n E4BGoogle · 7.9BQ3_K_M5.0 GB17.4 tok/sTight fit
66 ptsGood (B) · 66 of 100 points: Model quality 16.4/45, Memory fit 24.0/25, Speed 10.9/15, Memory use 15.0/15Qwen2.5-VL 7B InstructAlibaba · 8.3BQ2_K4.8 GB20.9 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 16.4/45, Memory fit 24.0/25, Speed 10.6/15, Memory use 15.0/15MiniCPM-o 2.6 8BOpenBMB · 8.7BQ2_K5.0 GB20.0 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 13.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.4/15EXAONE 4.0 1.2BLG AI Research · 1.3BQ8_02.9 GB42.0 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 12.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.0/15Granite 3.1 2B InstructIBM · 2.5BQ4_K_M3.2 GB41.8 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 15.4/45, Memory fit 25.0/25, Speed 10.5/15, Memory use 15.0/15Gemma 3n E2BGoogle · 5.4BQ4_K_M4.5 GB19.4 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 12.9/45, Memory fit 25.0/25, Speed 14.3/15, Memory use 13.6/15Qwen2.5-VL 3B InstructAlibaba · 3.8BQ3_K_M3.2 GB36.4 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 15.8/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15DeepSeek R1 Distill Llama 8BDeepSeek · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 15.8/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15InternVL2.5 8BShanghai AI Lab · 8.1BQ2_K5.3 GB21.5 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 16.6/45, Memory fit 24.0/25, Speed 10.0/15, Memory use 15.0/15Qwen2 7B InstructAlibaba · 7.6BQ3_K_M5.2 GB17.9 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 15.8/45, Memory fit 24.0/25, Speed 10.9/15, Memory use 15.0/15Fara 7BMicrosoft · 8.3BQ2_K4.8 GB20.9 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 16.4/45, Memory fit 24.0/25, Speed 10.2/15, Memory use 15.0/15GLM-4 9B 0414Zhipu AI · 9.4BQ2_K5.1 GB18.5 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 12.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.5/15Gemma 2 2BGoogle · 2.6BQ4_K_M3.1 GB40.5 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 16.6/45, Memory fit 24.0/25, Speed 9.8/15, Memory use 15.0/15Command R7BCohere · 8.0BQ3_K_M5.3 GB17.0 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 15.8/45, Memory fit 24.0/25, Speed 10.5/15, Memory use 15.0/15InternLM3 8B InstructShanghai AI Lab · 8.8BQ2_K5.0 GB19.7 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 10.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15SmolVLM2 2.2B InstructHugging Face · 2.3BQ4_K_M4.0 GB47.0 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 11.1/45, Memory fit 25.0/25, Speed 14.1/15, Memory use 15.0/15Granite Vision 3.2 2BIBM · 3.0BQ4_K_M3.5 GB35.5 tok/sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 15.1/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Hermes 3 (Llama 3.1 8B)Nous Research · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 15.1/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Llama 3.1 8B InstructMeta · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 15.1/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15MiniCPM-V 2.6 8BOpenBMB · 8.1BQ2_K4.7 GB21.4 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 14.5/45, Memory fit 24.0/25, Speed 11.4/15, Memory use 15.0/15Falcon 3 7B InstructTII · 7.5BQ2_K5.0 GB23.3 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 14.5/45, Memory fit 24.0/25, Speed 11.2/15, Memory use 15.0/15EXAONE 3.5 7.8BLG AI Research · 7.8BQ2_K5.2 GB22.2 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 15.9/45, Memory fit 24.0/25, Speed 9.8/15, Memory use 15.0/15Command R7B ArabicCohere · 8.0BQ3_K_M5.3 GB17.0 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 14.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.2/15LFM2.5 1.2B InstructLiquid AI · 1.2BQ8_02.4 GB46.0 tok/sRuns well
64 ptsGood (B) · 64 of 100 points: Model quality 14.5/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15DeepHermes 3 Llama 3 8B PreviewNous Research · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 14.5/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Dolphin 3.0 Llama 3.1 8BCognitive Computations · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 14.5/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Tülu 3 8BAi2 · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 9.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15SmolVLM 2.2B InstructHugging Face · 2.3BQ4_K_M4.0 GB47.0 tok/sRuns well
64 ptsGood (B) · 64 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 11.5/15, Memory use 15.0/15Phi-3 Small 8K InstructMicrosoft · 7.4BQ2_K5.1 GB23.5 tok/sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 15.1/45, Memory fit 24.0/25, Speed 10.2/15, Memory use 15.0/15GLM-4 9B Chat (2024)Zhipu AI · 9.4BQ2_K5.1 GB18.5 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 8.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15Granite 3.1 3B-A800M InstructIBM · 3.3B (0.8B active)Q6_K4.3 GB45.8 tok/sRuns well
63 ptsGood (B) · 63 of 100 points: Model quality 8.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15SmolLM2 1.7B InstructHugging Face · 1.7BQ6_K4.0 GB42.9 tok/sRuns well
63 ptsGood (B) · 63 of 100 points: Model quality 11.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.8/15Granite 3.0 2B InstructIBM · 2.6BQ4_K_M3.0 GB40.2 tok/sRuns well
63 ptsGood (B) · 63 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Dolphin 2.9.4 Llama 3.1 8BCognitive Computations · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Hermes 2 Pro Llama 3 8BNous Research · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15OpenChat 3.6 8BOpenChat · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15InternVL2 8BShanghai AI Lab · 8.1BQ2_K5.3 GB21.5 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 9.8/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15OLMoE 1B-7B InstructAi2 · 6.9B (1.3B active)Q3_K_M5.0 GB52.6 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 10.9/15, Memory use 15.0/15Qwen2-VL 7B InstructAlibaba · 8.3BQ2_K4.8 GB20.9 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 14.5/45, Memory fit 24.0/25, Speed 10.2/15, Memory use 15.0/15CodeGeeX4 All 9BZhipu AI · 9.4BQ2_K5.1 GB18.5 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 14.4/45, Memory fit 24.0/25, Speed 10.3/15, Memory use 15.0/15Falcon3 Mamba 7B InstructTII · 7.3BQ3_K_M4.6 GB18.8 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 13.9/45, Memory fit 24.0/25, Speed 10.6/15, Memory use 15.0/15Aya Vision 8BCohere · 8.6BQ2_K4.8 GB20.1 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 11.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.7/15DeepScaleR 1.5B PreviewAgentica · 1.8BQ6_K2.7 GB41.2 tok/sRuns well
63 ptsGood (B) · 63 of 100 points: Model quality 13.2/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Llama 3 8B InstructMeta · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 11.3/45, Memory fit 25.0/25, Speed 11.8/15, Memory use 15.0/15Qwen2.5-Omni 3BAlibaba · 5.5BQ3_K_M4.0 GB24.7 tok/sRuns well
63 ptsGood (B) · 63 of 100 points: Model quality 8.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15Granite 3.0 3B-A800M InstructIBM · 3.4B (0.8B active)Q6_K4.1 GB45.8 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 11.3/45, Memory fit 25.0/25, Speed 11.6/15, Memory use 15.0/15Codestral Mamba 7BMistral AI · 7.3BQ2_K4.0 GB23.8 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 9.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.1/15Hunyuan 1.8B InstructTencent · 1.8BQ6_K3.0 GB41.0 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 12.6/45, Memory fit 24.0/25, Speed 11.2/15, Memory use 15.0/15InternLM2.5 7B ChatShanghai AI Lab · 7.7BQ2_K5.2 GB22.4 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 11.3/45, Memory fit 25.0/25, Speed 11.3/15, Memory use 15.0/15Qwen2.5-Math 7B InstructAlibaba · 7.6BQ2_K4.3 GB22.8 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 12.6/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Aya Expanse 8BCohere · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 12.6/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Apertus 8B InstructSwiss AI · 8.1BQ2_K5.3 GB21.6 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 10.5/45, Memory fit 25.0/25, Speed 14.9/15, Memory use 12.2/15Qwen2-VL 2B InstructAlibaba · 2.2BQ5_K_M2.8 GB39.5 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 12.0/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Mistral 7B Instruct v0.3Mistral AI · 7.3BQ2_K5.0 GB23.9 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 12.6/45, Memory fit 24.0/25, Speed 10.9/15, Memory use 15.0/15Granite 3.0 8B InstructIBM · 8.2BQ2_K5.0 GB21.2 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 12.0/45, Memory fit 24.0/25, Speed 11.5/15, Memory use 15.0/15Zamba2 7B InstructZyphra · 7.4BQ2_K4.7 GB23.6 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 11.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.9/15Qwen2.5 Coder 1.5B InstructAlibaba · 1.5BQ6_K2.5 GB47.6 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 9.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.0/15Zamba2 2.7B InstructZyphra · 2.7BQ4_K_M3.0 GB39.7 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 11.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.8/15Falcon-H1 1.5B InstructTII · 1.6BQ6_K2.5 GB47.3 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 12.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.9/15Granite 4.0 H 1BIBM · 1.5BQ6_K2.3 GB50.2 tok/sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 12.0/45, Memory fit 24.0/25, Speed 11.2/15, Memory use 15.0/15EXAONE 3.0 7.8B InstructLG AI Research · 7.8BQ2_K4.7 GB22.2 tok/sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 7.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15Yi Coder 1.5B Chat01.AI · 1.5BQ6_K3.9 GB49.6 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 12.0/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Dolphin 2.9 Llama 3 8BCognitive Computations · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 11.3/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Hermes 2 Pro Mistral 7BNous Research · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 11.3/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Starling LM 7B BetaNexusflow · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 11.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.2/15LFM2 1.2BLiquid AI · 1.2BQ8_02.4 GB46.0 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 10.6/45, Memory fit 25.0/25, Speed 11.3/15, Memory use 15.0/15Yi 1.5 6B Chat01.AI · 6.1BQ3_K_M4.3 GB22.6 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 11.0/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15OpenChat 3.5 (0106)OpenChat · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 10.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.9/15Qwen2.5 1.5B InstructAlibaba · 1.5BQ6_K2.5 GB47.6 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 7.6/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15Stable Code Instruct 3BStability AI · 2.8BQ3_K_M5.1 GB48.8 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 7.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.7/15InternLM2.5 1.8B ChatShanghai AI Lab · 1.9BQ5_K_M3.2 GB46.2 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 9.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.7/15DeepSeek R1 Distill Qwen 1.5BDeepSeek · 1.8BQ6_K2.7 GB41.2 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 6.8/45, Memory fit 25.0/25, Speed 14.6/15, Memory use 15.0/15StableLM Zephyr 3BStability AI · 2.8BQ4_K_M4.1 GB37.8 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 10.7/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Mistral 7B Instruct v0.2Mistral AI · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 10.7/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Nous Hermes 2 Mistral 7B DPONous Research · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 10.7/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15OpenChat 3.5 (1210)OpenChat · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 10.7/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Mathstral 7BMistral AI · 7.3BQ2_K5.0 GB23.9 tok/sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 9.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.2/15Llama 3.2 1B InstructMeta · 1.2BQ8_02.6 GB43.4 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 10.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.4/15LFM2-VL 1.6BLiquid AI · 1.6BQ6_K2.4 GB46.4 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 6.8/45, Memory fit 25.0/25, Speed 14.6/15, Memory use 14.6/15Phi-2 2.7BMicrosoft · 2.8BQ4_K_M3.4 GB38.0 tok/sRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 9.5/45, Memory fit 25.0/25, Speed 11.6/15, Memory use 15.0/15Falcon Mamba 7B InstructTII · 7.3BQ2_K4.0 GB23.9 tok/sRuns well
60 ptsGood (B) · 60 of 100 points: Model quality 6.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.0/15Nemotron Mini 4B InstructNVIDIA · 4.2BQ2_K3.2 GB41.4 tok/sRuns well
60 ptsGood (B) · 60 of 100 points: Model quality 11.3/45, Memory fit 24.0/25, Speed 10.5/15, Memory use 15.0/15Yi 1.5 9B Chat01.AI · 8.8BQ2_K5.0 GB19.7 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 10.7/45, Memory fit 24.0/25, Speed 11.0/15, Memory use 15.0/15Aya 23 8BCohere · 8.0BQ2_K5.3 GB21.6 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 10.1/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15OpenHermes 2.5 Mistral 7BTeknium · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 10.1/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Starling LM 7B AlphaBerkeley · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 11.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 8.8/15Qwen3.5 0.8BAlibaba · 0.9BQ8_02.1 GB61.9 tok/sRuns well
60 ptsGood (B) · 60 of 100 points: Model quality 5.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15DeepSeek Coder 1.3B InstructDeepSeek · 1.4BQ8_04.1 GB39.9 tok/sRuns well
60 ptsGood (B) · 60 of 100 points: Model quality 10.1/45, Memory fit 24.0/25, Speed 11.2/15, Memory use 15.0/15InternLM2 Math Plus 7BShanghai AI Lab · 7.7BQ2_K5.2 GB22.4 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 6.3/45, Memory fit 24.0/25, Speed 15.0/15, Memory use 15.0/15Granite Code 3B Instruct (128K)IBM · 3.5BQ2_K5.1 GB49.9 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 9.5/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Mistral 7B Instruct v0.1Mistral AI · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 7.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.9/15Falcon 3 1B InstructTII · 1.7BQ6_K3.0 GB43.9 tok/sRuns well
59 ptsGood (B) · 59 of 100 points: Model quality 10.7/45, Memory fit 24.0/25, Speed 10.1/15, Memory use 15.0/15RecurrentGemma 9B ITGoogle · 9.6BQ2_K5.0 GB18.0 tok/sTight fit
59 ptsGood (B) · 59 of 100 points: Model quality 8.8/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Neural Chat 7B v3.3Intel · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
59 ptsGood (B) · 59 of 100 points: Model quality 8.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.4/15Qwen2.5-Math 1.5B InstructAlibaba · 1.5BQ6_K2.4 GB47.6 tok/sRuns well
59 ptsGood (B) · 59 of 100 points: Model quality 7.6/45, Memory fit 25.0/25, Speed 11.7/15, Memory use 15.0/15StarCoder2 7BBigCode · 7.2BQ2_K4.4 GB24.2 tok/sRuns well
59 ptsGood (B) · 59 of 100 points: Model quality 8.8/45, Memory fit 24.0/25, Speed 11.4/15, Memory use 15.0/15LLaVA 1.6 Mistral 7BLLaVA · 7.6BQ2_K5.1 GB22.9 tok/sTight fit
58 ptsGood (B) · 58 of 100 points: Model quality 6.3/45, Memory fit 25.0/25, Speed 12.7/15, Memory use 15.0/15Yi 6B Chat01.AI · 6.1BQ2_K3.7 GB28.6 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 8.2/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15WizardMath 7B v1.1WizardLM · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
58 ptsGood (B) · 58 of 100 points: Model quality 8.2/45, Memory fit 24.0/25, Speed 11.6/15, Memory use 15.0/15Zephyr 7B BetaHugging Face · 7.2BQ2_K5.0 GB24.0 tok/sTight fit
58 ptsGood (B) · 58 of 100 points: Model quality 6.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.9/15StarCoder2 3BBigCode · 3.0BQ3_K_M2.8 GB45.1 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 6.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.2/15SmolLM 1.7B InstructHugging Face · 1.7BQ6_K2.8 GB42.9 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 9.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.2/15Gemma 3 1BGoogle · 1.0BQ8_02.1 GB53.8 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 6.2/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.0/15OLMo 2 1B InstructAi2 · 1.5BQ6_K2.8 GB49.6 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 6.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.9/15Qwen3 0.6BAlibaba · 0.8BQ8_02.8 GB71.7 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 4.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.7/15StableLM 2 1.6B ChatStability AI · 1.6BQ6_K3.2 GB44.7 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 4.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 13.7/15StableLM 2 Zephyr 1.6BStability AI · 1.6BQ6_K3.2 GB44.7 tok/sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 7.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.9/15Qwen2 1.5B InstructAlibaba · 1.5BQ6_K2.5 GB47.6 tok/sRuns well
57 ptsUsable (C) · 57 of 100 points: Model quality 6.0/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.7/15CodeGemma 2BGoogle · 2.5BQ4_K_M2.7 GB42.1 tok/sRuns well
56 ptsUsable (C) · 56 of 100 points: Model quality 5.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 11.7/15Gemma 2B ITGoogle · 2.5BQ4_K_M2.7 GB42.1 tok/sRuns well
56 ptsUsable (C) · 56 of 100 points: Model quality 8.1/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 8.2/15LFM2 700MLiquid AI · 0.7BQ8_01.9 GB72.7 tok/sRuns well
56 ptsUsable (C) · 56 of 100 points: Model quality 3.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.5/15Hunyuan 0.5B InstructTencent · 0.5BF162.9 GB45.9 tok/sRuns well
56 ptsUsable (C) · 56 of 100 points: Model quality 21.4/45, Memory fit 10.0/25, Speed 9.7/15, Memory use 15.0/15Granite 4.2 8BIBM · 8.8BQ2_K5.9 GB16.8 tok/sRuns with offload
55 ptsUsable (C) · 55 of 100 points: Model quality 6.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.6/15Falcon-H1 0.5B InstructTII · 0.5BF162.2 GB47.7 tok/sRuns well
55 ptsUsable (C) · 55 of 100 points: Model quality 4.4/45, Memory fit 24.0/25, Speed 11.9/15, Memory use 15.0/15OLMo 7B InstructAi2 · 6.9BQ2_K4.9 GB25.2 tok/sTight fit
54 ptsUsable (C) · 54 of 100 points: Model quality 4.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 10.3/15SmolVLM 500M InstructHugging Face · 0.5BF162.4 GB48.6 tok/sRuns well
54 ptsUsable (C) · 54 of 100 points: Model quality 19.5/45, Memory fit 10.0/25, Speed 10.1/15, Memory use 15.0/15DeepSeek R1 0528 Qwen3 8BDeepSeek · 8.2BQ2_K5.5 GB18.0 tok/sRuns with offload
54 ptsUsable (C) · 54 of 100 points: Model quality 19.5/45, Memory fit 10.0/25, Speed 9.9/15, Memory use 15.0/15InternVL3.5 8BShanghai AI Lab · 8.5BQ2_K5.6 GB17.3 tok/sRuns with offload
54 ptsUsable (C) · 54 of 100 points: Model quality 3.8/45, Memory fit 24.0/25, Speed 11.5/15, Memory use 15.0/15InternLM 7BShanghai AI Lab · 7.3BQ2_K5.0 GB23.7 tok/sTight fit
54 ptsUsable (C) · 54 of 100 points: Model quality 19.5/45, Memory fit 10.0/25, Speed 9.7/15, Memory use 15.0/15Qwen3-VL 8B InstructAlibaba · 8.8BQ2_K5.7 GB16.8 tok/sRuns with offload
54 ptsUsable (C) · 54 of 100 points: Model quality 6.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 7.9/15LFM2.5 350MLiquid AI · 0.4BF161.8 GB70.9 tok/sRuns well
54 ptsUsable (C) · 54 of 100 points: Model quality 5.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 8.7/15LFM2-VL 450MLiquid AI · 0.5BF162.0 GB55.1 tok/sRuns well
53 ptsUsable (C) · 53 of 100 points: Model quality 18.9/45, Memory fit 10.0/25, Speed 10.1/15, Memory use 15.0/15Qwen3 8BAlibaba · 8.2BQ2_K5.5 GB18.0 tok/sRuns with offload
53 ptsUsable (C) · 53 of 100 points: Model quality 18.9/45, Memory fit 10.0/25, Speed 9.8/15, Memory use 15.0/15MiniCPM-V 4.5 8BOpenBMB · 8.7BQ2_K5.7 GB17.0 tok/sRuns with offload
53 ptsUsable (C) · 53 of 100 points: Model quality 18.9/45, Memory fit 10.0/25, Speed 9.7/15, Memory use 15.0/15Granite 4.1 8BIBM · 8.8BQ2_K5.9 GB16.8 tok/sRuns with offload
53 ptsUsable (C) · 53 of 100 points: Model quality 4.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.1/15Qwen2.5 0.5B InstructAlibaba · 0.5BF162.1 GB50.6 tok/sRuns well
53 ptsUsable (C) · 53 of 100 points: Model quality 1.9/45, Memory fit 25.0/25, Speed 11.6/15, Memory use 15.0/15Falcon 7B InstructTII · 7.2BQ2_K3.9 GB24.0 tok/sRuns well
53 ptsUsable (C) · 53 of 100 points: Model quality 26.1/45, Memory fit 4.0/25, Speed 8.3/15, Memory use 15.0/15Gemma 4 12BGoogle · 12BQ2_K6.5 GB12.3 tok/sHeavy offload
53 ptsUsable (C) · 53 of 100 points: Model quality 18.3/45, Memory fit 10.0/25, Speed 10.0/15, Memory use 15.0/15Seed-Coder 8B ReasoningByteDance · 8.3BQ2_K5.4 GB17.9 tok/sRuns with offload
53 ptsUsable (C) · 53 of 100 points: Model quality 5.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 7.9/15LFM2 350MLiquid AI · 0.4BF161.8 GB70.9 tok/sRuns well
53 ptsUsable (C) · 53 of 100 points: Model quality 18.3/45, Memory fit 10.0/25, Speed 10.0/15, Memory use 15.0/15MiMo-VL 7B RLXiaomi · 8.3BQ2_K5.6 GB17.8 tok/sRuns with offload
52 ptsUsable (C) · 52 of 100 points: Model quality 17.6/45, Memory fit 10.0/25, Speed 10.3/15, Memory use 15.0/15MiMo 7B RLXiaomi · 7.8BQ2_K5.4 GB18.8 tok/sRuns with offload
52 ptsUsable (C) · 52 of 100 points: Model quality 5.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 7.5/15Granite 4.0 H 350MIBM · 0.3BF161.7 GB72.9 tok/sRuns well
52 ptsUsable (C) · 52 of 100 points: Model quality 18.9/45, Memory fit 10.0/25, Speed 9.0/15, Memory use 15.0/15GLM-4.1V 9B ThinkingZhipu AI · 10BQ2_K5.5 GB14.3 tok/sRuns with offload
52 ptsUsable (C) · 52 of 100 points: Model quality 3.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.1/15Qwen2.5 Coder 0.5B InstructAlibaba · 0.5BF162.1 GB50.6 tok/sRuns well
52 ptsUsable (C) · 52 of 100 points: Model quality 17.0/45, Memory fit 10.0/25, Speed 10.7/15, Memory use 15.0/15Olmo 3 7B ThinkAi2 · 7.3BQ2_K5.4 GB20.2 tok/sRuns with offload
52 ptsUsable (C) · 52 of 100 points: Model quality 17.6/45, Memory fit 10.0/25, Speed 10.0/15, Memory use 15.0/15Seed-Coder 8B InstructByteDance · 8.3BQ2_K5.4 GB17.9 tok/sRuns with offload
52 ptsUsable (C) · 52 of 100 points: Model quality 3.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.0/15SmolLM2 360M InstructHugging Face · 0.4BF162.1 GB68.9 tok/sRuns well
52 ptsUsable (C) · 52 of 100 points: Model quality 2.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.6/15TinyLlama 1.1B ChatTinyLlama · 1.1BQ8_02.2 GB48.9 tok/sRuns well
52 ptsUsable (C) · 52 of 100 points: Model quality 12.6/45, Memory fit 10.0/25, Speed 14.7/15, Memory use 15.0/15Phi-3.5 Mini InstructMicrosoft · 3.8BQ2_K5.8 GB38.6 tok/sRuns with offload
52 ptsUsable (C) · 52 of 100 points: Model quality 17.6/45, Memory fit 10.0/25, Speed 9.6/15, Memory use 15.0/15Ministral 3 8BMistral AI · 8.9BQ2_K5.7 GB16.5 tok/sRuns with offload
51 ptsUsable (C) · 51 of 100 points: Model quality 2.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 9.1/15Qwen2 0.5B InstructAlibaba · 0.5BF162.1 GB50.6 tok/sRuns well
51 ptsUsable (C) · 51 of 100 points: Model quality 15.8/45, Memory fit 10.0/25, Speed 10.7/15, Memory use 15.0/15Olmo 3 7B InstructAi2 · 7.3BQ2_K5.4 GB20.2 tok/sRuns with offload
51 ptsUsable (C) · 51 of 100 points: Model quality 4.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 6.8/15LFM2.5 230MLiquid AI · 0.2BF161.6 GB108 tok/sRuns well
51 ptsUsable (C) · 51 of 100 points: Model quality 11.3/45, Memory fit 10.0/25, Speed 14.7/15, Memory use 15.0/15Phi-3 Mini 128K InstructMicrosoft · 3.8BQ2_K5.8 GB38.6 tok/sRuns with offload
50 ptsUsable (C) · 50 of 100 points: Model quality 2.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 8.2/15ERNIE 4.5 0.3BBaidu · 0.4BF161.9 GB68.9 tok/sRuns well
50 ptsUsable (C) · 50 of 100 points: Model quality 2.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 7.5/15SmolVLM 256M InstructHugging Face · 0.3BF161.7 GB95.4 tok/sRuns well
50 ptsUsable (C) · 50 of 100 points: Model quality 2.3/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 7.9/15SmolLM 360M InstructHugging Face · 0.4BF161.8 GB68.9 tok/sRuns well
49 ptsUsable (C) · 49 of 100 points: Model quality 14.5/45, Memory fit 10.0/25, Speed 10.2/15, Memory use 15.0/15Ministral 8B (2410)Mistral AI · 8.0BQ2_K5.4 GB18.4 tok/sRuns with offload
49 ptsUsable (C) · 49 of 100 points: Model quality 2.7/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 6.9/15Gemma 3 270MGoogle · 0.3BF161.6 GB91.9 tok/sRuns well
49 ptsUsable (C) · 49 of 100 points: Model quality 14.5/45, Memory fit 10.0/25, Speed 10.1/15, Memory use 15.0/15Granite 3.2 8B InstructIBM · 8.2BQ2_K5.6 GB18.1 tok/sRuns with offload
49 ptsUsable (C) · 49 of 100 points: Model quality 14.5/45, Memory fit 10.0/25, Speed 10.1/15, Memory use 15.0/15Granite 3.3 8BIBM · 8.2BQ2_K5.6 GB18.1 tok/sRuns with offload
49 ptsUsable (C) · 49 of 100 points: Model quality 15.1/45, Memory fit 10.0/25, Speed 9.4/15, Memory use 15.0/15GLM-4 9B Chat 1MZhipu AI · 9.5BQ2_K5.5 GB15.6 tok/sRuns with offload
49 ptsUsable (C) · 49 of 100 points: Model quality 14.5/45, Memory fit 10.0/25, Speed 9.7/15, Memory use 15.0/15Apertus v1.5 8BSwiss AI · 8.9BQ2_K5.7 GB16.6 tok/sRuns with offload
48 ptsUsable (C) · 48 of 100 points: Model quality 13.9/45, Memory fit 10.0/25, Speed 10.1/15, Memory use 15.0/15Granite 3.1 8B InstructIBM · 8.2BQ2_K5.6 GB18.1 tok/sRuns with offload
48 ptsUsable (C) · 48 of 100 points: Model quality 14.5/45, Memory fit 10.0/25, Speed 8.8/15, Memory use 15.0/15Qwen2.5-Omni 7BAlibaba · 11BQ2_K5.8 GB13.8 tok/sRuns with offload
48 ptsUsable (C) · 48 of 100 points: Model quality 13.2/45, Memory fit 10.0/25, Speed 9.9/15, Memory use 15.0/15Mistral-NeMo-Minitron 8B InstructNVIDIA · 8.4BQ2_K5.7 GB17.5 tok/sRuns with offload
48 ptsUsable (C) · 48 of 100 points: Model quality 1.8/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 6.4/15SmolLM2 135M InstructHugging Face · 0.1BF161.5 GB191 tok/sRuns well
47 ptsUsable (C) · 47 of 100 points: Model quality 12.6/45, Memory fit 10.0/25, Speed 9.7/15, Memory use 15.0/15Yi Coder 9B Chat01.AI · 8.8BQ2_K5.4 GB16.7 tok/sRuns with offload
46 ptsUsable (C) · 46 of 100 points: Model quality 1.4/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 5.6/15Falcon-H1 Tiny 90M InstructTII · 0.1BF161.3 GB276 tok/sRuns well
46 ptsUsable (C) · 46 of 100 points: Model quality 0.9/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 5.8/15SmolLM 135M InstructHugging Face · 0.1BF161.3 GB191 tok/sRuns well
46 ptsUsable (C) · 46 of 100 points: Model quality 18.9/45, Memory fit 4.0/25, Speed 8.2/15, Memory use 15.0/15Gemma 3 12B ITGoogle · 12BQ2_K6.6 GB12.1 tok/sHeavy offload
45 ptsUsable (C) · 45 of 100 points: Model quality 14.4/45, Memory fit 4.0/25, Speed 12.5/15, Memory use 15.0/15Phi-3.5 Vision InstructMicrosoft · 4.2BQ3_K_M6.3 GB28.0 tok/sHeavy offload
45 ptsUsable (C) · 45 of 100 points: Model quality 10.1/45, Memory fit 10.0/25, Speed 10.2/15, Memory use 15.0/15Granite Code 8B Instruct (128K)IBM · 8.1BQ2_K5.5 GB18.3 tok/sRuns with offload
44 ptsUsable (C) · 44 of 100 points: Model quality 12.9/45, Memory fit 4.0/25, Speed 12.5/15, Memory use 15.0/15Phi-3 Vision 128K InstructMicrosoft · 4.2BQ3_K_M6.3 GB28.0 tok/sHeavy offload
44 ptsUsable (C) · 44 of 100 points: Model quality 16.4/45, Memory fit 4.0/25, Speed 9.0/15, Memory use 15.0/15Falcon 3 10B InstructTII · 10BQ2_K6.5 GB14.3 tok/sHeavy offload
44 ptsUsable (C) · 44 of 100 points: Model quality 15.8/45, Memory fit 4.0/25, Speed 9.5/15, Memory use 15.0/15Gemma 2 9B ITGoogle · 9.2BQ2_K6.3 GB16.0 tok/sHeavy offload
43 ptsUsable (C) · 43 of 100 points: Model quality 6.9/45, Memory fit 10.0/25, Speed 11.1/15, Memory use 15.0/15Orca 2 7BMicrosoft · 6.7BQ2_K5.9 GB21.9 tok/sRuns with offload
42 ptsUsable (C) · 42 of 100 points: Model quality 6.3/45, Memory fit 10.0/25, Speed 11.1/15, Memory use 15.0/15Llama 2 7B ChatMeta · 6.7BQ2_K5.9 GB21.9 tok/sRuns with offload
41 ptsPoor (D) · 41 of 100 points: Model quality 5.7/45, Memory fit 10.0/25, Speed 11.0/15, Memory use 15.0/15DeepSeek LLM 7B ChatDeepSeek · 6.9BQ2_K5.8 GB21.4 tok/sRuns with offload
41 ptsPoor (D) · 41 of 100 points: Model quality 13.2/45, Memory fit 4.0/25, Speed 8.8/15, Memory use 15.0/15Llama 3.2 11B Vision InstructMeta · 11BQ2_K6.6 GB13.8 tok/sHeavy offload
41 ptsPoor (D) · 41 of 100 points: Model quality 11.3/45, Memory fit 4.0/25, Speed 10.7/15, Memory use 15.0/15OLMo 2 7B InstructAi2 · 7.3BQ2_K6.1 GB20.2 tok/sHeavy offload
40 ptsPoor (D) · 40 of 100 points: Model quality 4.4/45, Memory fit 10.0/25, Speed 11.1/15, Memory use 15.0/15Vicuna 7B v1.5LMSYS · 6.7BQ2_K5.9 GB21.9 tok/sRuns with offload
40 ptsPoor (D) · 40 of 100 points: Model quality 12.6/45, Memory fit 4.0/25, Speed 8.8/15, Memory use 15.0/15Nous Hermes 2 SOLAR 10.7BNous Research · 11BQ2_K6.1 GB13.8 tok/sHeavy offload
40 ptsPoor (D) · 40 of 100 points: Model quality 12.6/45, Memory fit 4.0/25, Speed 8.8/15, Memory use 15.0/15SOLAR 10.7B InstructUpstage · 11BQ2_K6.1 GB13.8 tok/sHeavy offload
35 ptsPoor (D) · 35 of 100 points: Model quality 6.3/45, Memory fit 4.0/25, Speed 10.5/15, Memory use 15.0/15Baichuan 2 7B ChatBaichuan · 7.5BQ2_K6.2 GB19.6 tok/sHeavy offload
34 ptsPoor (D) · 34 of 100 points: Model quality 5.0/45, Memory fit 4.0/25, Speed 10.8/15, Memory use 15.0/15LLaVA 1.5 7BLLaVA · 7.1BQ2_K6.0 GB20.9 tok/sHeavy offload
11 ptsWon't run (F) · 11 of 100 points: Model quality 11.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15gpt-oss 120BOpenAI · 117B (5.1B active)MXFP467.9 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15gpt-oss 20BOpenAI · 21B (3.6B active)MXFP413.2 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiMo V2.6 Pro (1T-A42B)Xiaomi · 1,024B (42.0B active)Q2_K411 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.8 Max (2.4T-A95B)Alibaba · 2,446B (95.0B active)Q2_K980 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K3 (2.8T)Moonshot AI · 2,780B (104.0B active)Q2_K1,113 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-5.3 (753B-A40B)Zhipu AI · 753B (40.0B active)Q2_K303 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiMo V2.6 Flash (310B-A15B)Xiaomi · 311B (15.0B active)Q2_K126 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V4 Pro (1.6T-A49B)DeepSeek · 1,651B (49.0B active)Q2_K662 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.8 Flash Next (125B-A6B)Alibaba · 180B (6.0B active)Q2_K73.2 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-5.2 (753B-A40B)Zhipu AI · 753B (40.0B active)Q2_K303 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hunyuan Hy4 Preview (780B)Tencent · 780B (55.0B active)Q2_K314 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K2.6 (1T)Moonshot AI · 1,027B (32.0B active)Q2_K412 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.8 27BAlibaba · 28BQ2_K12.7 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-5.3 Flash (320B-A18B)Zhipu AI · 321B (18.0B active)Q2_K130 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-5.1 (744B-A40B)Zhipu AI · 754B (40.0B active)Q2_K303 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V4 Pro (April 2026)DeepSeek · 1,599B (49.0B active)Q2_K641 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.5 397B-A17BAlibaba · 403B (17.0B active)Q2_K163 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax M3 (427B)MiniMax · 427B (25.0B active)Q2_K173 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-5 (744B-A40B)Zhipu AI · 754B (40.0B active)Q2_K303 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hunyuan Hy3 (295B-A21B)Tencent · 299B (21.0B active)Q2_K123 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K2.5 (1T)Moonshot AI · 1,027B (32.0B active)Q2_K412 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K2.7 Code (1T)Moonshot AI · 1,027B (32.0B active)Q2_K412 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V4 Flash (284B-A13B)DeepSeek · 304B (13.0B active)Q2_K123 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ornith 1.5 397B-A17BDeepReinforce · 403B (17.0B active)Q2_K163 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.6 27BAlibaba · 28BQ2_K12.7 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V3.2 (671B)DeepSeek · 685B (37.0B active)Q2_K276 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.7 (355B-A32B)Zhipu AI · 358B (32.0B active)Q2_K147 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax M2.7 (230B-A10B)MiniMax · 229B (10.0B active)Q2_K94.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.6 35B-A3BAlibaba · 36B (3.0B active)Q2_K15.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Nemotron 3 Ultra 550B-A55BNVIDIA · 561B (55.0B active)Q2_K225 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek R1 0528 (671B)DeepSeek · 685B (37.0B active)Q2_K275 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K2 Thinking (1T)Moonshot AI · 1,026B (32.0B active)Q2_K412 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.5 27BAlibaba · 28BQ2_K12.7 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.5 35B-A3BAlibaba · 36B (3.0B active)Q2_K15.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V3.2 ExpDeepSeek · 685B (37.0B active)Q2_K276 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Gemma 4 26B-A4BGoogle · 26B (3.8B active)Q2_K11.8 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax M2.5 (230B-A10B)MiniMax · 229B (10.0B active)Q2_K94.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek R1 (671B)DeepSeek · 671B (37.0B active)Q2_K270 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V4 Flash (April 2026)DeepSeek · 291B (13.0B active)Q2_K118 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3.5 122B-A10BAlibaba · 125B (10.0B active)Q2_K51.3 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Step 3.5 Flash (196B-A11B)StepFun · 199B (11.0B active)Q2_K81.2 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V3.1 TerminusDeepSeek · 685B (37.0B active)Q2_K275 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V3.1 (671B)DeepSeek · 685B (37.0B active)Q2_K275 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Gemma 4 31BGoogle · 31BQ2_K15.1 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K2 Instruct 0905 (1T)Moonshot AI · 1,026B (32.0B active)Q2_K412 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax M2.1 (230B-A10B)MiniMax · 229B (10.0B active)Q2_K94.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 235B-A22B Thinking 2507Alibaba · 235B (22.0B active)Q2_K96.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 Coder 480B-A35BAlibaba · 480B (35.0B active)Q2_K195 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiMo V2 Flash (309B-A15B)Xiaomi · 310B (15.0B active)Q2_K125 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ling 1TAnt Group (inclusionAI) · 1,000B (50.0B active)Q2_K404 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Large 3 (675B)Mistral AI · 675B (41.0B active)Q2_K272 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ornith 1.5 35B-A3BDeepReinforce · 36B (3.0B active)Q2_K15.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 235B-A22B Instruct 2507Alibaba · 235B (22.0B active)Q2_K96.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Solar Open 2 250BUpstage · 250B (15.0B active)Q2_K103 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15TMax 27BAi2 · 27BQ2_K12.5 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Apodex 1.1 Mini (35B-A3B)Apodex · 36B (3.0B active)Q2_K15.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi K2 Instruct (July 2025)Moonshot AI · 1,026B (32.0B active)Q2_K412 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax M2 (230B-A10B)MiniMax · 229B (10.0B active)Q2_K94.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ornith 1.0 35B-A3BDeepReinforce · 36B (3.0B active)Q2_K15.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3-VL 235B-A22B InstructAlibaba · 236B (22.0B active)Q2_K96.9 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Fara 1.5 27BMicrosoft · 27BQ2_K12.5 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.7 Flash (30B-A3B)Zhipu AI · 31B (3.0B active)Q2_K14.0 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15K-EXAONE 236B-A23BLG AI Research · 237B (23.0B active)Q2_K96.3 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LongCat Flash Chat (560B)Meituan · 562B (27.0B active)Q2_K226 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Nemotron 3 Super 120B-A12BNVIDIA · 124B (12.0B active)Q2_K50.5 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 235B-A22BAlibaba · 235B (22.0B active)Q2_K96.6 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Agents-A1 35B-A3BInternScience · 35B (3.0B active)Q2_K15.2 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen AgentWorld 35B-A3BAlibaba · 35B (3.0B active)Q2_K15.1 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Devstral 2 (123B)Mistral AI · 125BQ2_K54.0 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternVL3.5 241B-A28BShanghai AI Lab · 241B (28.0B active)Q2_K98.9 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Laguna S 2.1 (118B-A8B)Poolside · 118B (8.0B active)Q2_K49.7 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.1 Nemotron Ultra 253B v1NVIDIA · 253BQ2_K107 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 Coder Next (80B-A3B)Alibaba · 80B (3.0B active)Q2_K33.1 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3-Next 80B-A3B ThinkingAlibaba · 81B (3.0B active)Q2_K33.8 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15UI-Mate 27BTencent · 27BQ2_K12.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Baichuan M3 235B-A22BBaichuan · 235B (22.0B active)Q2_K96.6 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.6 (355B-A32B)Zhipu AI · 357B (32.0B active)Q2_K147 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 Next 80B-A3B InstructAlibaba · 81B (3.0B active)Q2_K33.8 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V3 0324 (671B)DeepSeek · 685B (37.0B active)Q2_K275 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.6VZhipu AI · 108B (12.0B active)Q2_K45.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax-M1 80KMiniMax · 456B (45.9B active)Q2_K184 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Command A Reasoning (111B)Cohere · 111BQ2_K46.2 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15EXAONE 4.5 33BLG AI Research · 34BQ2_K15.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.5 (355B-A32B)Zhipu AI · 358B (32.0B active)Q2_K147 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Laguna XS 2.1 (33B-A3B)Poolside · 33B (3.0B active)Q2_K15.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ling 3.0 Flash (127B-A5B)Ant Group (inclusionAI) · 127B (5.1B active)Q2_K52.4 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.3 70B InstructMeta · 71BQ2_K32.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax-M1 40KMiniMax · 456B (45.9B active)Q2_K184 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Small 4 (119B-A6B)Mistral AI · 119B (6.0B active)Q2_K49.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Medium 3.5 (128B)Mistral AI · 128BQ2_K55.1 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Trinity Large Thinking (400B-A13B)Arcee AI · 399B (13.0B active)Q2_K161 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Command A (111B)Cohere · 111BQ2_K46.2 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15ERNIE 4.5 300B-A47BBaidu · 300B (47.0B active)Q2_K123 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.5VZhipu AI · 108B (12.0B active)Q2_K45.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hermes 4 405BNous Research · 406BQ2_K168 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi Dev 72BMoonshot AI · 73BQ2_K32.8 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.3 Nemotron Super 49B v1.5NVIDIA · 50BQ2_K23.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Large 2.1 (2411)Mistral AI · 123BQ2_K53.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Nemotron Cascade 2 30B-A3BNVIDIA · 32B (3.5B active)Q2_K13.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15North Mini Code 1.0 (30B-A3B)Cohere · 30B (3.0B active)Q2_K13.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Seed-OSS 36B InstructByteDance · 36BQ2_K17.6 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Solar Open 100BUpstage · 103B (12.0B active)Q2_K43.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hermes 4.3 36BNous Research · 36BQ2_K17.6 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DiffusionGemma 26B-A4B ITGoogle · 26B (4.0B active)Q2_K11.8 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4.5 Air (106B-A12B)Zhipu AI · 110B (12.0B active)Q2_K46.8 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Large 2 (123B)Mistral AI · 123BQ2_K53.2 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Pixtral Large 124B (2411)Mistral AI · 124BQ2_K53.6 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 30B-A3B Thinking 2507Alibaba · 31B (3.3B active)Q2_K14.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 Coder 30B-A3BAlibaba · 31B (3.3B active)Q2_K14.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3-VL 32B InstructAlibaba · 33BQ2_K16.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15QwQ 32BAlibaba · 33BQ2_K16.3 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ring Flash 2.0 (100B-A6B)Ant Group (inclusionAI) · 103B (6.1B active)Q2_K42.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Nemotron 3 Nano 30B-A3BNVIDIA · 32B (3.5B active)Q2_K13.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 30B-A3B Instruct 2507Alibaba · 31B (3.3B active)Q2_K14.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Devstral Small 2 (24B)Mistral AI · 24BQ2_K12.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15dots.llm1 Instructrednote · 143B (14.0B active)Q2_K66.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Granite 4.2 30BIBM · 29BQ2_K14.9 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternVL3.5 38BShanghai AI Lab · 38BQ2_K18.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ling Flash 2.0 (100B-A6B)Ant Group (inclusionAI) · 103B (6.1B active)Q2_K42.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MiniMax-Text-01MiniMax · 456B (45.9B active)Q2_K184 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Olmo 3.1 32B ThinkAi2 · 32BQ2_K14.7 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15OpenReasoning Nemotron 32BNVIDIA · 33BQ2_K16.3 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 32BAlibaba · 33BQ2_K16.3 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3-VL 30B-A3B ThinkingAlibaba · 31B (3.3B active)Q2_K14.3 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Skywork OR1 32BSkywork · 33BQ2_K16.3 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Tülu 3 405BAi2 · 406BQ2_K168 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V3 (671B)DeepSeek · 671B (37.0B active)Q2_K270 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Sarvam 105BSarvam AI · 106B (10.0B active)Q2_K43.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek Coder V2 (236B)DeepSeek · 236B (21.0B active)Q2_K95.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15EXAONE Deep 32BLG AI Research · 32BQ2_K16.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-4 32B 0414Zhipu AI · 33BQ2_K14.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15GLM-Z1 32B (0414)Zhipu AI · 33BQ2_K14.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hermes 4 70BNous Research · 71BQ2_K31.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hunyuan A13B (80B-A13B)Tencent · 80B (13.0B active)Q2_K34.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternVL3 78BShanghai AI Lab · 78BQ2_K35.1 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi Linear 48B-A3BMoonshot AI · 49B (3.0B active)Q2_K20.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Leanstral 119B-A6BMistral AI · 119B (6.5B active)Q2_K49.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 30B-A3BAlibaba · 31B (3.3B active)Q2_K14.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3-VL 30B-A3B InstructAlibaba · 31B (3.3B active)Q2_K14.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5 72B InstructAlibaba · 73BQ2_K32.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5-VL 72B InstructAlibaba · 73BQ2_K33.1 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Apriel 1.5 15B ThinkerServiceNow · 15BQ2_K8.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek Coder V2 Instruct (0614)DeepSeek · 236B (21.0B active)Q2_K95.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek R1 Distill Llama 70BDeepSeek · 71BQ2_K31.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek R1 Distill Qwen 32BDeepSeek · 33BQ2_K16.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V2.5 1210DeepSeek · 236B (21.0B active)Q2_K95.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15EXAONE 4.0 32BLG AI Research · 32BQ2_K14.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Gemma 3 27B ITGoogle · 27BQ2_K12.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Granite 4.1 30BIBM · 29BQ2_K14.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.1 405B InstructMeta · 406BQ2_K168 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 4 Maverick (17B x 128E)Meta · 402B (17.0B active)Q2_K163 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 4 Scout 17B-16EMeta · 109B (17.0B active)Q2_K46.1 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Magistral Small 1.2 (24B)Mistral AI · 24BQ2_K12.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Nemotron 3.5 Lightning 30B-A3BNVIDIA · 32B (3.0B active)Q2_K13.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Olmo 3.1 32B InstructAi2 · 32BQ2_K14.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-4 Reasoning Plus (14B)Microsoft · 15BQ2_K8.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Tülu 3 70BAi2 · 71BQ2_K31.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Baichuan M2 32BBaichuan · 33BQ2_K16.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Command R+ (08-2024) 104BCohere · 104BQ2_K44.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V2.5DeepSeek · 236B (21.0B active)Q2_K95.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Devstral Small 1.1 (24B)Mistral AI · 24BQ2_K11.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15ERNIE 4.5 21B-A3B ThinkingBaidu · 22B (3.0B active)Q2_K10.2 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternVL3 38BShanghai AI Lab · 38BQ2_K18.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Jamba 1.5 LargeAI21 Labs · 399B (94.0B active)Q2_K161 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.1 70B InstructMeta · 71BQ2_K32.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Magistral Small 2507Mistral AI · 24BQ2_K11.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15MedGemma 27B Text ITGoogle · 27BQ2_K12.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15OpenHands LM 32BAll Hands AI · 33BQ2_K16.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-4 Reasoning (14B)Microsoft · 15BQ2_K8.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-4 Reasoning Vision 15BMicrosoft · 15BQ2_K8.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5 32B InstructAlibaba · 33BQ2_K16.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3-Omni 30B-A3B InstructAlibaba · 35B (3.3B active)Q2_K15.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Sarvam 30BSarvam AI · 32B (2.4B active)Q2_K14.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hermes 3 (Llama 3.1 70B)Nous Research · 71BQ2_K31.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Magistral Small 2506Mistral AI · 24BQ2_K11.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Small 3.2 24BMistral AI · 24BQ2_K12.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15QVQ 72B PreviewAlibaba · 73BQ2_K33.1 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5-VL 32B InstructAlibaba · 33BQ2_K16.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen3 14BAlibaba · 15BQ2_K8.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5 Coder 32B InstructAlibaba · 33BQ2_K16.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15AceReason Nemotron 14BNVIDIA · 15BQ2_K8.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Apertus v1.5 70BSwiss AI · 72BQ2_K32.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Apriel Nemotron 15B ThinkerServiceNow · 15BQ2_K8.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Devstral Small 2505Mistral AI · 24BQ2_K11.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Hermes 4 14BNous Research · 15BQ2_K8.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.1 Nemotron 70B InstructNVIDIA · 71BQ2_K31.9 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3.2 90B Vision InstructMeta · 89BQ2_K39.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ministral 3 14B ReasoningMistral AI · 14BQ2_K8.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Small 3.1 24BMistral AI · 24BQ2_K12.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15OpenReasoning Nemotron 14BNVIDIA · 15BQ2_K8.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5 Coder 14B InstructAlibaba · 15BQ2_K8.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15QwQ 32B PreviewAlibaba · 33BQ2_K16.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Reka Flash 3.1 (21B)Reka AI · 21BQ2_K10.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Trinity Mini (26B-A3B)Arcee AI · 26B (3.0B active)Q2_K11.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Command R+ 104B (04-2024)Cohere · 104BQ2_K44.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepCoder 14B PreviewAgentica · 15BQ2_K8.5 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15ERNIE 4.5 21B-A3BBaidu · 22B (3.0B active)Q2_K10.3 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Falcon-H1 34B InstructTII · 34BQ2_K15.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternVL3 14BShanghai AI Lab · 15BQ2_K8.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ministral 3 14BMistral AI · 14BQ2_K8.0 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Small 3 24B (2501)Mistral AI · 24BQ2_K11.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-4 (14B)Microsoft · 15BQ2_K8.6 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2 72B InstructAlibaba · 73BQ2_K32.8 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2-VL 72B InstructAlibaba · 73BQ2_K33.1 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Codestral 22BMistral AI · 22BQ2_K11.8 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Command R (08-2024) 32BCohere · 32BQ2_K15.3 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek R1 Distill Qwen 14BDeepSeek · 15BQ2_K8.5 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V2 ChatDeepSeek · 236B (21.0B active)Q2_K95.9 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Dolphin Mistral 24B Venice EditionCognitive Computations · 24BQ2_K12.0 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Gemma 2 27B ITGoogle · 27BQ2_K13.7 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Granite 4.0 H Small (32B-A9B)IBM · 32B (9.0B active)Q2_K14.0 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15JanusCoder 14BShanghai AI Lab · 15BQ2_K8.3 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5 14B InstructAlibaba · 15BQ2_K8.5 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Voxtral Small 24BMistral AI · 24BQ2_K12.1 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Apertus 70B InstructSwiss AI · 71BQ2_K32.0 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Aya Expanse 32BCohere · 32BQ2_K15.3 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Aya Vision 32BCohere · 33BQ2_K15.6 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Dolphin 3.0 R1 Mistral 24BCognitive Computations · 24BQ2_K11.8 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi-VL A3B Thinking 2506Moonshot AI · 16B (3.0B active)Q2_K7.8 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15OLMo 2 32B InstructAi2 · 32BQ2_K15.0 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5 14B Instruct 1MAlibaba · 15BQ2_K8.5 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Solar Pro Preview 22BUpstage · 22BQ2_K11.2 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 3 70B InstructMeta · 71BQ2_K31.9 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2.5-Math 72B InstructAlibaba · 73BQ2_K31.5 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LFM2 24B-A2BLiquid AI · 24B (2.3B active)Q2_K10.7 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-3.5 MoE (42B-A6.6B)Microsoft · 42B (6.6B active)Q2_K18.9 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mixtral 8x22B InstructMistral AI · 141B (39.0B active)Q2_K59.2 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Command R 35B (v01)Cohere · 35BQ2_K25.8 GB—Won't run
5 ptsWon't run (F) · 5 of 100 points: Model quality 5.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Small 22B (2409)Mistral AI · 22BQ2_K11.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek Coder V2 Lite (16B)DeepSeek · 16B (2.4B active)Q2_K7.6 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Ling Mini 2.0 (16B-A1.4B)Ant Group (inclusionAI) · 16B (1.4B active)Q2_K7.9 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mistral Nemo 12B InstructMistral AI · 12BQ2_K7.3 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Nous Hermes 2 Mixtral 8x7B DPONous Research · 47B (12.9B active)Q2_K20.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen1.5 110B ChatAlibaba · 111BQ2_K48.2 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Aya 23 35BCohere · 35BQ2_K25.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Grok-1 (314B)xAI · 314B (86.0B active)Q2_K129 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternLM2.5 20B ChatShanghai AI Lab · 20BQ2_K10.6 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Jamba 1.5 MiniAI21 Labs · 52B (12.0B active)Q2_K21.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Kimi-VL A3B InstructMoonshot AI · 16B (3.0B active)Q2_K7.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mixtral 8x7B InstructMistral AI · 47B (12.9B active)Q2_K20.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Pixtral 12B (2409)Mistral AI · 12BQ2_K7.3 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen2 57B-A14B InstructAlibaba · 57B (14.0B active)Q2_K24.5 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Snowflake Arctic InstructSnowflake · 479B (17.0B active)Q2_K193 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Yi 1.5 34B Chat01.AI · 34BQ2_K15.8 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Moonlight 16B-A3B InstructMoonshot AI · 16B (3.0B active)Q2_K7.7 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-3 Medium (14B)Microsoft · 14BQ2_K7.5 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Phi-3 Medium 128K InstructMicrosoft · 14BQ2_K8.3 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Code Llama 70B InstructMeta · 69BQ2_K30.0 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek Coder 33B InstructDeepSeek · 33BQ2_K16.4 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LLaVA 1.6 34BLLaVA · 35BQ2_K15.9 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15OLMo 2 13B InstructAi2 · 14BQ2_K9.9 GB—Won't run
4 ptsWon't run (F) · 4 of 100 points: Model quality 4.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen1.5 32B ChatAlibaba · 33BQ2_K16.2 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 4.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternLM2 Chat 20BShanghai AI Lab · 20BQ2_K10.6 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek LLM 67B ChatDeepSeek · 67BQ2_K29.6 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek Prover V2 7BDeepSeek · 6.9BQ2_K7.8 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek V2 Lite ChatDeepSeek · 16B (2.4B active)Q2_K7.6 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Granite Code 34B InstructIBM · 34BQ2_K14.9 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15InternLM2 Math Plus 20BShanghai AI Lab · 20BQ2_K10.6 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15StarCoder2 15B InstructBigCode · 16BQ2_K8.1 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Yi 34B Chat01.AI · 34BQ2_K15.8 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Code Llama 34B InstructMeta · 34BQ2_K16.1 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15CogVLM2 Llama 3 Chat 19BZhipu AI · 20BQ2_K13.1 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Granite Code 20B InstructIBM · 20BQ2_K9.3 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.4/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 2 70B ChatMeta · 69BQ2_K30.0 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15CodeGemma 7BGoogle · 8.5BQ2_K8.2 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek Coder 6.7B InstructDeepSeek · 6.7BQ2_K8.0 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Falcon 180B ChatTII · 180BQ2_K73.2 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen1.5 14B ChatAlibaba · 14BQ2_K13.4 GB—Won't run
3 ptsWon't run (F) · 3 of 100 points: Model quality 3.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15StarCoder2 15B (base)BigCode · 16BQ2_K8.1 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Code Llama 13B InstructMeta · 13BQ2_K12.9 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15SQLCoder 7B v2Defog · 6.7BQ2_K8.0 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Gemma 1.1 7B ITGoogle · 8.5BQ2_K8.2 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Orca 2 13BMicrosoft · 13BQ2_K9.6 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15StableLM 2 12B ChatStability AI · 12BQ2_K6.7 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Baichuan 2 13B ChatBaichuan · 14BQ2_K9.9 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15DeepSeek MoE 16B ChatDeepSeek · 16B (2.8B active)Q2_K8.5 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Gemma 7B ITGoogle · 8.5BQ2_K8.2 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Llama 2 13B ChatMeta · 13BQ2_K9.6 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen1.5 7B ChatAlibaba · 7.7BQ2_K8.4 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15StarCoder 15BBigCode · 16BQ2_K7.5 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Code Llama 7B InstructMeta · 6.7BQ2_K8.0 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen1.5 MoE A2.7B ChatAlibaba · 14B (2.7B active)Q2_K8.4 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LLaVA 1.5 13BLLaVA · 13BQ2_K9.7 GB—Won't run
2 ptsWon't run (F) · 2 of 100 points: Model quality 2.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15WizardLM 13B v1.2WizardLM · 13BQ2_K9.6 GB—Won't run
1 ptsWon't run (F) · 1 of 100 points: Model quality 1.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Vicuna 13B v1.5LMSYS · 13BQ2_K9.6 GB—Won't run
1 ptsWon't run (F) · 1 of 100 points: Model quality 1.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Falcon 40B InstructTII · 42BQ2_K18.0 GB—Won't run

Image models on your Apple M2 (8 GB)

Grade · points Model Precision Memory Time per output Fit
75 ptsGreat (A) · 75 of 100 points: Model quality 32.6/45, Memory fit 18.0/25, Speed 9.5/15, Memory use 15.0/15FLUX.2 [klein] 4BBlack Forest Labs · 3.9BQ4 GGUF4.6 GB25 sTight fit
72 ptsGreat (A) · 72 of 100 points: Model quality 17.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 15.0/15SDXL TurboStability AI · 2.6BFP84.2 GB2.7 sRuns well
70 ptsGood (B) · 70 of 100 points: Model quality 37.0/45, Memory fit 12.0/25, Speed 6.2/15, Memory use 15.0/15Z-Image TurboAlibaba (Tongyi) · 6.2BFP84.4 GB58 sRuns well
69 ptsGood (B) · 69 of 100 points: Model quality 23.8/45, Memory fit 18.0/25, Speed 13.1/15, Memory use 15.0/15SDXL-Lightning (4-step)ByteDance · 2.6BFP84.7 GB13 sTight fit
68 ptsGood (B) · 68 of 100 points: Model quality 35.2/45, Memory fit 12.0/25, Speed 6.3/15, Memory use 15.0/15FLUX.2 [klein] 9BBlack Forest Labs · 9.1BQ4 GGUF4.3 GB56 sRuns well
68 ptsGood (B) · 68 of 100 points: Model quality 25.6/45, Memory fit 18.0/25, Speed 9.6/15, Memory use 15.0/15DreamShaper XL v2 TurboLykon · 2.6BFP84.7 GB24 sTight fit
66 ptsGood (B) · 66 of 100 points: Model quality 12.6/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 14.1/15SD TurboStability AI · 0.9BFP163.3 GB1.6 sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 36.5/45, Memory fit 12.0/25, Speed 2.1/15, Memory use 15.0/15Z-ImageAlibaba (Tongyi) · 6.2BQ8 GGUF4.5 GB8.4 minRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 18.9/45, Memory fit 25.0/25, Speed 9.7/15, Memory use 12.0/15Realistic Vision V5.1SG161222 · 0.9BFP162.8 GB24 sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 13.5/45, Memory fit 25.0/25, Speed 15.0/15, Memory use 12.0/15LCM DreamShaper v7Tsinghua (LCM) · 0.9BFP162.8 GB5.0 sRuns well
65 ptsGood (B) · 65 of 100 points: Model quality 27.3/45, Memory fit 18.0/25, Speed 5.2/15, Memory use 15.0/15Juggernaut XL v9RunDiffusion · 2.6BFP84.7 GB85 sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 27.3/45, Memory fit 18.0/25, Speed 5.2/15, Memory use 15.0/15RealVisXL V5.0SG161222 · 2.6BFP84.7 GB85 sTight fit
65 ptsGood (B) · 65 of 100 points: Model quality 22.5/45, Memory fit 20.0/25, Speed 8.5/15, Memory use 14.1/15PixArt-Σ XL 1024PixArt · 0.6BFP163.3 GB31 sRuns well
64 ptsGood (B) · 64 of 100 points: Model quality 26.5/45, Memory fit 18.0/25, Speed 5.5/15, Memory use 15.0/15KolorsKuaishou · 2.6BFP84.8 GB75 sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 26.5/45, Memory fit 18.0/25, Speed 5.3/15, Memory use 15.0/15Animagine XL 4.0Cagliostro Lab · 2.6BFP84.7 GB79 sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 26.5/45, Memory fit 18.0/25, Speed 5.3/15, Memory use 15.0/15Illustrious XL v0.1OnomaAI · 2.6BFP84.7 GB79 sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 18.0/45, Memory fit 25.0/25, Speed 9.7/15, Memory use 12.0/15DreamShaper 8Lykon · 0.9BFP162.8 GB24 sRuns well
64 ptsGood (B) · 64 of 100 points: Model quality 27.3/45, Memory fit 18.0/25, Speed 4.1/15, Memory use 15.0/15Lumina-Image 2.0Shanghai AI Lab · 2.6BFP84.9 GB2.2 minTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 25.6/45, Memory fit 18.0/25, Speed 5.6/15, Memory use 15.0/15Pony Diffusion V6 XLPurpleSmartAI · 2.6BFP84.7 GB72 sTight fit
64 ptsGood (B) · 64 of 100 points: Model quality 22.9/45, Memory fit 20.0/25, Speed 6.2/15, Memory use 15.0/15Stable Diffusion 3 MediumStability AI · 2.0BFP84.3 GB58 sRuns well
63 ptsGood (B) · 63 of 100 points: Model quality 26.5/45, Memory fit 18.0/25, Speed 4.0/15, Memory use 15.0/15Playground v2.5Playground AI · 2.6BFP84.7 GB2.4 minTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 25.6/45, Memory fit 18.0/25, Speed 4.5/15, Memory use 15.0/15Stable Diffusion 3.5 MediumStability AI · 2.5BFP84.8 GB1.9 minTight fit
63 ptsGood (B) · 63 of 100 points: Model quality 24.7/45, Memory fit 18.0/25, Speed 5.3/15, Memory use 15.0/15Animagine XL 3.1Cagliostro Lab · 2.6BFP84.7 GB79 sTight fit
62 ptsGood (B) · 62 of 100 points: Model quality 15.8/45, Memory fit 25.0/25, Speed 9.7/15, Memory use 12.0/15Stable Diffusion 1.5Stability AI / Runway · 0.9BFP162.8 GB24 sRuns well
62 ptsGood (B) · 62 of 100 points: Model quality 24.3/45, Memory fit 18.0/25, Speed 5.2/15, Memory use 15.0/15Stable Diffusion XL 1.0Stability AI · 2.6BFP84.7 GB85 sTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 34.3/45, Memory fit 10.0/25, Speed 2.5/15, Memory use 15.0/15FLUX.1 Krea [dev]Black Forest Labs · 11.9BQ4 GGUF5.1 GB6.2 minTight fit
61 ptsGood (B) · 61 of 100 points: Model quality 32.6/45, Memory fit 12.0/25, Speed 2.0/15, Memory use 15.0/15Chroma1-HDLodestone Rock · 8.9BNF44.3 GB9.5 minRuns well
61 ptsGood (B) · 61 of 100 points: Model quality 33.5/45, Memory fit 10.0/25, Speed 2.6/15, Memory use 15.0/15FLUX.1 [dev]Black Forest Labs · 11.9BNF45.0 GB5.7 minTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 23.4/45, Memory fit 18.0/25, Speed 4.2/15, Memory use 15.0/15Hunyuan-DiT v1.2Tencent · 1.5BFP165.2 GB2.1 minTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 29.3/45, Memory fit 10.0/25, Speed 6.3/15, Memory use 15.0/15FLUX.1 [schnell]Black Forest Labs · 11.9BNF45.0 GB57 sTight fit
60 ptsGood (B) · 60 of 100 points: Model quality 30.9/45, Memory fit 12.0/25, Speed 2.3/15, Memory use 15.0/15CogView4 6BZhipu AI · 6.4BFP84.4 GB7.0 minRuns well
59 ptsGood (B) · 59 of 100 points: Model quality 25.9/45, Memory fit 12.0/25, Speed 6.7/15, Memory use 15.0/15Stable Diffusion 3.5 Large TurboStability AI · 8.1BQ4 GGUF4.1 GB50 sRuns well
58 ptsGood (B) · 58 of 100 points: Model quality 29.1/45, Memory fit 12.0/25, Speed 2.5/15, Memory use 15.0/15OmniGen2BAAI (VectorSpaceLab) · 4.0BFP83.8 GB6.2 minRuns well
57 ptsUsable (C) · 57 of 100 points: Model quality 27.6/45, Memory fit 12.0/25, Speed 2.6/15, Memory use 15.0/15Stable Diffusion 3.5 LargeStability AI · 8.1BQ4 GGUF4.1 GB5.7 minRuns well
54 ptsUsable (C) · 54 of 100 points: Model quality 22.9/45, Memory fit 12.0/25, Speed 4.4/15, Memory use 15.0/15Stable CascadeStability AI · 5.2BFP84.0 GB1.9 minRuns well
53 ptsUsable (C) · 53 of 100 points: Model quality 24.3/45, Memory fit 12.0/25, Speed 2.3/15, Memory use 15.0/15AuraFlow v0.3fal · 6.9BQ4 GGUF3.7 GB7.3 minRuns well
51 ptsUsable (C) · 51 of 100 points: Model quality 21.6/45, Memory fit 12.0/25, Speed 3.1/15, Memory use 15.0/15Kandinsky 3Sber AI · 3.0BFP164.2 GB3.9 minRuns well
11 ptsWon't run (F) · 11 of 100 points: Model quality 11.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HunyuanImage 3.0 (80B-A13B)Tencent · 83.0BFP832.8 GB—Won't run
11 ptsWon't run (F) · 11 of 100 points: Model quality 11.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen-ImageAlibaba · 20.4BFP813.3 GB—Won't run
11 ptsWon't run (F) · 11 of 100 points: Model quality 11.6/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15FLUX.2 [dev]Black Forest Labs · 32.2BQ4 GGUF10.1 GB—Won't run
11 ptsWon't run (F) · 11 of 100 points: Model quality 11.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen-Image 2512Alibaba · 20.4BQ4 GGUF10.4 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Qwen-Image-Edit 2511Alibaba · 20.4BQ4 GGUF7.8 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HiDream-I1 FullHiDream.ai · 17.1BNF46.2 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15FLUX.1 Kontext [dev]Black Forest Labs · 11.9BQ4 GGUF5.8 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15FLUX.1 Fill [dev]Black Forest Labs · 11.9BFP86.8 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HiDream-I1 DevHiDream.ai · 17.1BNF46.2 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HiDream-I1 FastHiDream.ai · 17.1BNF46.2 GB—Won't run

Video models on your Apple M2 (8 GB)

Grade · points Model Precision Memory Time per output Fit
63 ptsGood (B) · 63 of 100 points: Model quality 15.8/45, Memory fit 23.0/25, Speed 10.1/15, Memory use 15.0/15AnimateDiff v3 (SD 1.5)Shanghai AI Lab · 1.3BFP164.7 GB6.6 minTight fit
57 ptsUsable (C) · 57 of 100 points: Model quality 22.1/45, Memory fit 12.0/25, Speed 8.3/15, Memory use 15.0/15LTX-Video 2BLightricks · 1.9BFP84.0 GB9.7 minRuns well
50 ptsUsable (C) · 50 of 100 points: Model quality 19.8/45, Memory fit 10.0/25, Speed 5.4/15, Memory use 15.0/15CogVideoX 2BZhipu AI · 1.7BFP84.7 GB23.3 minTight fit
11 ptsWon't run (F) · 11 of 100 points: Model quality 11.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HunyuanVideo 1.5 (8.3B)Tencent · 8.3BFP823.9 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LTX-2.3Lightricks · 18.9BQ4 GGUF16.4 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.2 I2V A14BAlibaba · 14.0BQ4 GGUF21.3 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.2 T2V A14BAlibaba · 14.0BQ4 GGUF21.3 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15SkyReels V2 T2V 14B 720PSkywork · 14.0BFP826.0 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LTX-2 (19B, video + audio)Lightricks · 18.9BQ4 GGUF16.4 GB—Won't run
10 ptsWon't run (F) · 10 of 100 points: Model quality 10.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Step-Video T2V (30B)StepFun · 30.0BFP825.0 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.1 I2V 14B 720PAlibaba · 14.0BQ4 GGUF21.3 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.1 T2V 14BAlibaba · 14.0BQ4 GGUF21.3 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.1 VACE 14BAlibaba · 17.3BQ4 GGUF22.0 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.2 Animate 14BAlibaba · 17.3BQ4 GGUF21.3 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15FramePack I2V (HunyuanVideo 13B)lllyasviel · 12.9BFP810.8 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15SkyReels V2 T2V 14B 540PSkywork · 14.0BFP814.2 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.2 S2V 14B (speech to video)Alibaba · 16.3BQ4 GGUF9.0 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.5/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Open-Sora 2.0 (11B)HPC-AI Tech · 11.0BFP1619.3 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.1 I2V 14B 480PAlibaba · 14.0BQ4 GGUF8.5 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Cosmos-Predict2 14B Video2WorldNVIDIA · 14.0BFP824.7 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HunyuanVideo 13BTencent · 13.0BQ4 GGUF24.8 GB—Won't run
9 ptsWon't run (F) · 9 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15HunyuanVideo I2V 13BTencent · 13.0BQ4 GGUF24.8 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 9.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15LTX-Video 13B 0.9.8 (distilled)Lightricks · 13.0BFP816.1 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.8/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.2 TI2V 5BAlibaba · 5.0BQ4 GGUF21.4 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.2/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Mochi 1 Preview (10B)Genmo · 10.0BFP814.7 GB—Won't run
8 ptsWon't run (F) · 8 of 100 points: Model quality 8.1/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Cosmos 1.0 Diffusion 7B Text2WorldNVIDIA · 7.0BFP1629.2 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15CogVideoX 1.5 5BZhipu AI · 5.6BFP831.2 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.7/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Cosmos-Predict2 2B Video2WorldNVIDIA · 2.0BFP820.5 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15CogVideoX 5BZhipu AI · 5.0BFP85.9 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15CogVideoX 5B I2VZhipu AI · 5.6BFP86.1 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.1 T2V 1.3BAlibaba · 1.3BFP86.0 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.3/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Wan 2.1 VACE 1.3BAlibaba · 2.2BFP86.3 GB—Won't run
7 ptsWon't run (F) · 7 of 100 points: Model quality 7.0/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15Allegro (2.8B)Rhymes AI · 2.8BFP1624.7 GB—Won't run
6 ptsWon't run (F) · 6 of 100 points: Model quality 6.9/45, Memory fit 0.0/25, Speed 0.0/15, Memory use 0.0/15SkyReels V2 Diffusion Forcing 1.3BSkywork · 1.4BFP89.8 GB—Won't run

Upgrade picks

GPUs that would run more LLMs without offloading, at launch prices. Right now 207 of 536 LLMs run well on your Apple M2 (8 GB).

Cheapest upgrade Intel Arc A380 6.0 GB · $139 launch price +37 LLMs run well, including Granite 4.2 8B
Best value AMD Radeon RX 7600 XT 16.0 GB · $329 launch price +166 LLMs run well, including Qwen3.8 27B
Biggest jump NVIDIA RTX PRO 6000 Blackwell 96.0 GB · $8,565 launch price +258 LLMs run well, including Qwen3.8 Flash Next (125B-A6B)

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.