| Format | What it is | Opens in |
|---|---|---|
| GGUF | One file, already quantized, with the settings inside. The most widely supported format for local use. | llama.cpp, Ollama, LM Studio, Jan, Lemonade, Docker Model Runner |
| MLX | Apple’s array framework. Quantized weights laid out for Apple silicon, often faster than GGUF there. | LM Studio, MLX LM and others, on a Mac only |
| Safetensors | The original weights, usually 16-bit, plus quantized variants such as AWQ, GPTQ and FP8. Built for servers. | vLLM, SGLang, Hugging Face Transformers |
Rules of thumb
- Windows or Linux with a graphics card, one user: GGUF in LM Studio or Ollama.
- Mac: try the MLX build first in LM Studio; use GGUF if a model has no MLX version.
- A server for a team or an app: safetensors in vLLM, which batches many requests.
You rarely have to choose by hand: every model page lists the files that exist and picks the best app for your hardware. Browse all apps to see which formats each one reads.