Weekly archive

New local AI models, Mar 3–9, 2025

6 open models released Mar 3–9, 2025, with how each runs on five reference devices.

  1. mxbai-rerank-large v2

    Mixedbread · Decision · 1.5B ·

    82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  2. QwQ 32B

    Alibaba · LLM · 33B ·

    74Great quality (A) · 74 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  3. mxbai-rerank-base v2

    Mixedbread · Decision · 490M ·

    76Great quality (A) · 76 of 100: how capable the model is at F16, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  4. HunyuanVideo I2V 13B

    Tencent · Video · 13.0B ·

    72Great quality (A) · 72 of 100: how capable the model is at FP16, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  5. CogView4 6B

    Zhipu AI · Image · 6.4B ·

    70Great quality (A) · 70 of 100: how capable the model is at FP16, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  6. Open-Sora 2.0 (11B)

    HPC-AI Tech · Video · 11.0B ·

    70Great quality (A) · 70 of 100: how capable the model is at FP16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?