Check my GPU

Best local LLMs for the Apple M4 (32 GB)

Each list assumes the context length that task usually needs, so a model that fits for chat may drop down the list for long documents.

General chat at 8K context

  1. 93 ptsExcellent (S) · 93 of 100 points: Model quality 39.5/45, Memory fit 24.0/25, Speed 9.7/15, Memory use 15.0/15, workload match +5.0 Gemma 4 26B-A4B Q4_K_M · 16.7 tok/s · Tight fit
  2. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.3/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.6 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  3. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  4. 90 ptsExcellent (S) · 90 of 100 points: Model quality 33.3/45, Memory fit 25.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 GLM-4.7 Flash (30B-A3B) Q3_K_M · 27.3 tok/s · Runs well
  5. 90 ptsExcellent (S) · 90 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Ornith 1.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit

Coding at 32K context

  1. 93 ptsExcellent (S) · 93 of 100 points: Model quality 39.5/45, Memory fit 24.0/25, Speed 9.7/15, Memory use 15.0/15, workload match +5.0 Gemma 4 26B-A4B Q4_K_M · 16.7 tok/s · Tight fit
  2. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.3/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.6 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  3. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  4. 90 ptsExcellent (S) · 90 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Ornith 1.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  5. 90 ptsExcellent (S) · 90 of 100 points: Model quality 33.6/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Apodex 1.1 Mini (35B-A3B) Q3_K_M · 27.3 tok/s · Tight fit

Reasoning at 32K context

  1. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.3/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.6 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  2. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  3. 90 ptsExcellent (S) · 90 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Ornith 1.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  4. 90 ptsExcellent (S) · 90 of 100 points: Model quality 33.6/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Apodex 1.1 Mini (35B-A3B) Q3_K_M · 27.3 tok/s · Tight fit
  5. 90 ptsExcellent (S) · 90 of 100 points: Model quality 33.6/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Ornith 1.0 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit

Documents (RAG) at 32K context

  1. 93 ptsExcellent (S) · 93 of 100 points: Model quality 39.5/45, Memory fit 24.0/25, Speed 9.7/15, Memory use 15.0/15, workload match +5.0 Gemma 4 26B-A4B Q4_K_M · 16.7 tok/s · Tight fit
  2. 89 ptsExcellent (S) · 89 of 100 points: Model quality 40.9/45, Memory fit 24.0/25, Speed 5.1/15, Memory use 15.0/15, workload match +5.0 Qwen3.8 27B Q4_K_M · 4.6 tok/s · Tight fit
  3. 88 ptsExcellent (S) · 88 of 100 points: Model quality 39.8/45, Memory fit 24.0/25, Speed 5.1/15, Memory use 15.0/15, workload match +5.0 Qwen3.5 27B Q4_K_M · 4.6 tok/s · Tight fit
  4. 88 ptsExcellent (S) · 88 of 100 points: Model quality 37.0/45, Memory fit 25.0/25, Speed 6.4/15, Memory use 15.0/15, workload match +5.0 Gemma 4 12B Q6_K · 7.4 tok/s · Runs well
  5. 86 ptsExcellent (S) · 86 of 100 points: Model quality 35.3/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15 Qwen3.6 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit

Agents & tools at 64K context

  1. 93 ptsExcellent (S) · 93 of 100 points: Model quality 39.5/45, Memory fit 24.0/25, Speed 9.7/15, Memory use 15.0/15, workload match +5.0 Gemma 4 26B-A4B Q4_K_M · 16.7 tok/s · Tight fit
  2. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.3/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.6 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  3. 91 ptsExcellent (S) · 91 of 100 points: Model quality 35.2/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Qwen3.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  4. 90 ptsExcellent (S) · 90 of 100 points: Model quality 34.0/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Ornith 1.5 35B-A3B Q3_K_M · 27.3 tok/s · Tight fit
  5. 90 ptsExcellent (S) · 90 of 100 points: Model quality 33.6/45, Memory fit 24.0/25, Speed 12.4/15, Memory use 15.0/15, workload match +5.0 Apodex 1.1 Mini (35B-A3B) Q3_K_M · 27.3 tok/s · Tight fit

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.