Apps · Desktop app

GPT4All

by Nomic AI · MIT · 77,347 GitHub stars

Free, open-source chat app from Nomic with a built-in model library and LocalDocs, which answers from your own files.

macOSWindowsLinux

Get GPT4All

At a glance

Best for
First-time users who want private chat over their own documents.
Inference engine
  • llama.cpp
GPU support
  • Vulkan (AMD, Intel, NVIDIA)
  • NVIDIA CUDA
  • Apple Metal
  • CPU only
Opens
  • GGUF
Features
  • Chat window
  • OpenAI-compatible API
  • Curated model library
Platforms
macOS, Windows and Linux. Its last release was in 2025, so models released after that may not load.

Sources:

Install

macOS

Download from nomic.ai

Windows

Download from nomic.ai

Linux

Download from nomic.ai

287 models on this site run in GPT4All

Based on the files published for each model: GGUF. Open a model to see the exact command or file for your quantization.

Model Made by Type Size Opens it as Quality tier
DeepSeek R1 0528 (671B) DeepSeek LLM 685B (37.0B active) GGUF 93
DeepSeek R1 (671B) DeepSeek LLM 671B (37.0B active) GGUF 92
Qwen3 235B-A22B Alibaba LLM 235B (22.0B active) GGUF 88
Llama 3.1 Nemotron Ultra 253B v1 NVIDIA LLM 253B GGUF 86
DeepSeek V3 0324 (671B) DeepSeek LLM 685B (37.0B active) GGUF 83
Command A (111B) Cohere LLM 111B GGUF 80
Mistral Large 2.1 (2411) Mistral AI LLM 123B GGUF 80
Mistral Large 2 (123B) Mistral AI LLM 123B GGUF 78
QwQ 32B Alibaba LLM 33B GGUF 78
dots.llm1 Instruct rednote LLM 143B (14.0B active) GGUF 76
Qwen3 32B Alibaba LLM 33B GGUF 76
Skywork OR1 32B Skywork LLM 33B GGUF 76
Tülu 3 405B Ai2 LLM 406B GGUF 76
DeepSeek V3 (671B) DeepSeek LLM 671B (37.0B active) GGUF 75
DeepSeek Coder V2 (236B) DeepSeek LLM 236B (21.0B active) GGUF 74
EXAONE Deep 32B LG AI Research LLM 32B GGUF 74
GLM-4 32B 0414 Zhipu AI LLM 33B GGUF 74
GLM-Z1 32B (0414) Zhipu AI LLM 33B GGUF 74
InternVL3 78B Shanghai AI Lab LLM 78B GGUF 74
Llama 3.3 70B Instruct Meta LLM 71B GGUF 74
Qwen3 30B-A3B Alibaba LLM 31B (3.3B active) GGUF 74
Qwen2.5 72B Instruct Alibaba LLM 73B GGUF 73
Qwen2.5-VL 72B Instruct Alibaba LLM 73B GGUF 73
DeepSeek Coder V2 Instruct (0614) DeepSeek LLM 236B (21.0B active) GGUF 72
DeepSeek R1 Distill Llama 70B DeepSeek LLM 71B GGUF 72
DeepSeek R1 Distill Qwen 32B DeepSeek LLM 33B GGUF 72
DeepSeek V2.5 1210 DeepSeek LLM 236B (21.0B active) GGUF 72
Gemma 3 27B IT Google LLM 27B GGUF 72
Llama 3.1 405B Instruct Meta LLM 406B GGUF 72
Llama 4 Maverick (17B x 128E) Meta LLM 402B (17.0B active) GGUF 72
Llama 4 Scout 17B-16E Meta LLM 109B (17.0B active) GGUF 72
Phi-4 Reasoning Plus (14B) Microsoft LLM 15B GGUF 72
Tülu 3 70B Ai2 LLM 71B GGUF 72
Command R+ (08-2024) 104B Cohere LLM 104B GGUF 70
DeepSeek V2.5 DeepSeek LLM 236B (21.0B active) GGUF 70
InternVL3 38B Shanghai AI Lab LLM 38B GGUF 70
Llama 3.1 70B Instruct Meta LLM 71B GGUF 70
MedGemma 27B Text IT Google LLM 27B GGUF 70
OpenHands LM 32B All Hands AI LLM 33B GGUF 70
Phi-4 Reasoning (14B) Microsoft LLM 15B GGUF 70
Qwen2.5 32B Instruct Alibaba LLM 33B GGUF 70
Hermes 3 (Llama 3.1 70B) Nous Research LLM 71B GGUF 68
QVQ 72B Preview Alibaba LLM 73B GGUF 68
Qwen2.5-VL 32B Instruct Alibaba LLM 33B GGUF 68
Qwen3 14B Alibaba LLM 15B GGUF 68
Qwen2.5 Coder 32B Instruct Alibaba LLM 33B GGUF 67
AceReason Nemotron 14B NVIDIA LLM 15B GGUF 66
Apriel Nemotron 15B Thinker ServiceNow LLM 15B GGUF 66
Devstral Small 2505 Mistral AI LLM 24B GGUF 66
Llama 3.1 Nemotron 70B Instruct NVIDIA LLM 71B GGUF 66
Mistral Small 3.1 24B Mistral AI LLM 24B GGUF 66
Qwen2.5 Coder 14B Instruct Alibaba LLM 15B GGUF 66
QwQ 32B Preview Alibaba LLM 33B GGUF 66
Command R+ 104B (04-2024) Cohere LLM 104B GGUF 64
DeepCoder 14B Preview Agentica LLM 15B GGUF 64
Falcon-H1 34B Instruct TII LLM 34B GGUF 64
InternVL3 14B Shanghai AI Lab LLM 15B GGUF 64
Mistral Small 3 24B (2501) Mistral AI LLM 24B GGUF 64
Phi-4 (14B) Microsoft LLM 15B GGUF 64
Qwen2 72B Instruct Alibaba LLM 73B GGUF 64
Qwen2-VL 72B Instruct Alibaba LLM 73B GGUF 64
Codestral 22B Mistral AI LLM 22B GGUF 62
Command R (08-2024) 32B Cohere LLM 32B GGUF 62
DeepSeek R1 0528 Qwen3 8B DeepSeek LLM 8.2B GGUF 62
DeepSeek R1 Distill Qwen 14B DeepSeek LLM 15B GGUF 62
DeepSeek V2 Chat DeepSeek LLM 236B (21.0B active) GGUF 62
Gemma 2 27B IT Google LLM 27B GGUF 62
Qwen2.5 14B Instruct Alibaba LLM 15B GGUF 62
Aya Expanse 32B Cohere LLM 32B GGUF 60
Dolphin 3.0 R1 Mistral 24B Cognitive Computations LLM 24B GGUF 60
Gemma 3 12B IT Google LLM 12B GGUF 60
OLMo 2 32B Instruct Ai2 LLM 32B GGUF 60
Qwen2.5 14B Instruct 1M Alibaba LLM 15B GGUF 60
Qwen3 8B Alibaba LLM 8.2B GGUF 60
Solar Pro Preview 22B Upstage LLM 22B GGUF 60
GLM-Z1 9B (0414) Zhipu AI LLM 9.4B GGUF 58
Llama 3 70B Instruct Meta LLM 71B GGUF 58
LLM4Decompile 22B V2 LLM4Binary LLM 22B GGUF 58
MiMo-VL 7B RL Xiaomi LLM 8.3B GGUF 58
Qwen2.5-Math 72B Instruct Alibaba LLM 73B GGUF 58
Seed-Coder 8B Reasoning ByteDance LLM 8.3B GGUF 58
EXAONE Deep 7.8B LG AI Research LLM 7.8B GGUF 56
InternVL3 8B Shanghai AI Lab LLM 7.9B GGUF 56
Phi-3.5 MoE (42B-A6.6B) Microsoft LLM 42B (6.6B active) GGUF 56
Seed-Coder 8B Instruct ByteDance LLM 8.3B GGUF 56
Mixtral 8x22B Instruct Mistral AI LLM 141B (39.0B active) GGUF 55
Qwen2.5 Coder 7B Instruct Alibaba LLM 7.6B GGUF 55
Command R 35B (v01) Cohere LLM 35B GGUF 54
Llama 3.1 Nemotron Nano 8B v1 NVIDIA LLM 8.0B GGUF 54
Mistral Small 22B (2409) Mistral AI LLM 22B GGUF 54
DeepSeek Coder V2 Lite (16B) DeepSeek LLM 16B (2.4B active) GGUF 52
Falcon 3 10B Instruct TII LLM 10B GGUF 52
GLM-4 9B 0414 Zhipu AI LLM 9.4B GGUF 52
MiniCPM-o 2.6 8B OpenBMB LLM 8.7B GGUF 52
Mistral Nemo 12B Instruct Mistral AI LLM 12B GGUF 52
Nous Hermes 2 Mixtral 8x7B DPO Nous Research LLM 47B (12.9B active) GGUF 52
Qwen1.5 110B Chat Alibaba LLM 111B GGUF 52
Qwen2.5 7B Instruct Alibaba LLM 7.6B GGUF 52
Qwen2.5-VL 7B Instruct Alibaba LLM 8.3B GGUF 52
Aya 23 35B Cohere LLM 35B GGUF 50
DeepSeek R1 Distill Llama 8B DeepSeek LLM 8.0B GGUF 50
Falcon-H1 7B Instruct TII LLM 7.6B GGUF 50
Gemma 2 9B IT Google LLM 9.2B GGUF 50
Grok-1 (314B) xAI LLM 314B (86.0B active) GGUF 50
InternLM2.5 20B Chat Shanghai AI Lab LLM 20B GGUF 50
InternLM3 8B Instruct Shanghai AI Lab LLM 8.8B GGUF 50
Jamba 1.5 Mini AI21 Labs LLM 52B (12.0B active) GGUF 50
Kimi-VL A3B Instruct Moonshot AI LLM 16B (3.0B active) GGUF 50
Mixtral 8x7B Instruct Mistral AI LLM 47B (12.9B active) GGUF 50
Qwen2 57B-A14B Instruct Alibaba LLM 57B (14.0B active) GGUF 50
Qwen2.5 7B Instruct 1M Alibaba LLM 7.6B GGUF 50
Qwen3 4B Alibaba LLM 4.0B GGUF 50
Yi 1.5 34B Chat 01.AI LLM 34B GGUF 50
GLM-4 9B Chat (2024) Zhipu AI LLM 9.4B GGUF 48
GLM-4 9B Chat 1M Zhipu AI LLM 9.5B GGUF 48
Hermes 3 (Llama 3.1 8B) Nous Research LLM 8.0B GGUF 48
Llama 3.1 8B Instruct Meta LLM 8.0B GGUF 48
MiniCPM-V 2.6 8B OpenBMB LLM 8.1B GGUF 48
CodeGeeX4 All 9B Zhipu AI LLM 9.4B GGUF 46
DeepHermes 3 Llama 3 8B Preview Nous Research LLM 8.0B GGUF 46
DeepSeek R1 Distill Qwen 7B DeepSeek LLM 7.6B GGUF 46
Dolphin 3.0 Llama 3.1 8B Cognitive Computations LLM 8.0B GGUF 46
EXAONE 3.5 7.8B LG AI Research LLM 7.8B GGUF 46
Falcon 3 7B Instruct TII LLM 7.5B GGUF 46
Granite 3.2 8B Instruct IBM LLM 8.2B GGUF 46
Granite 3.3 8B IBM LLM 8.2B GGUF 46
Ministral 8B (2410) Mistral AI LLM 8.0B GGUF 46
Phi-3 Medium (14B) Microsoft LLM 14B GGUF 46
Phi-3 Medium 128K Instruct Microsoft LLM 14B GGUF 46
Phi-4 Mini Reasoning (3.8B) Microsoft LLM 3.8B GGUF 46
Qwen2.5-Omni 7B Alibaba LLM 11B GGUF 46
Tülu 3 8B Ai2 LLM 8.0B GGUF 46
Gemma 3 4B IT Google LLM 4.3B GGUF 45
Code Llama 70B Instruct Meta LLM 69B GGUF 44
Command R7B Cohere LLM 8.0B GGUF 44
DeepSeek Coder 33B Instruct DeepSeek LLM 33B GGUF 44
Dolphin 2.9.4 Llama 3.1 8B Cognitive Computations LLM 8.0B GGUF 44
Granite 3.1 8B Instruct IBM LLM 8.2B GGUF 44
Hermes 2 Pro Llama 3 8B Nous Research LLM 8.0B GGUF 44
Llama 3.1 Nemotron Nano 4B v1.1 NVIDIA LLM 4.5B GGUF 44
MedGemma 4B IT Google LLM 4.3B GGUF 44
OLMo 2 13B Instruct Ai2 LLM 14B GGUF 44
OpenChat 3.6 8B OpenChat LLM 8.0B GGUF 44
Phi-4 Mini (3.8B) Microsoft LLM 3.8B GGUF 44
Qwen1.5 32B Chat Alibaba LLM 33B GGUF 44
Qwen2 7B Instruct Alibaba LLM 7.6B GGUF 44
Qwen2-VL 7B Instruct Alibaba LLM 8.3B GGUF 44
InternLM2 Chat 20B Shanghai AI Lab LLM 20B GGUF 42
Llama 3 8B Instruct Meta LLM 8.0B GGUF 42
Mistral-NeMo-Minitron 8B Instruct NVIDIA LLM 8.4B GGUF 42
Aya Expanse 8B Cohere LLM 8.0B GGUF 40
DeepSeek LLM 67B Chat DeepSeek LLM 67B GGUF 40
DeepSeek Prover V2 7B DeepSeek LLM 6.9B GGUF 40
DeepSeek V2 Lite Chat DeepSeek LLM 16B (2.4B active) GGUF 40
Granite 3.0 8B Instruct IBM LLM 8.2B GGUF 40
Granite Code 34B Instruct IBM LLM 34B GGUF 40
InternLM2 Math Plus 20B Shanghai AI Lab LLM 20B GGUF 40
InternLM2.5 7B Chat Shanghai AI Lab LLM 7.7B GGUF 40
Nous Hermes 2 SOLAR 10.7B Nous Research LLM 11B GGUF 40
Phi-3.5 Mini Instruct Microsoft LLM 3.8B GGUF 40
SOLAR 10.7B Instruct Upstage LLM 11B GGUF 40
StarCoder2 15B Instruct BigCode LLM 16B GGUF 40
Yi 34B Chat 01.AI LLM 34B GGUF 40
Yi Coder 9B Chat 01.AI LLM 8.8B GGUF 40
Code Llama 34B Instruct Meta LLM 34B GGUF 38
Dolphin 2.9 Llama 3 8B Cognitive Computations LLM 8.0B GGUF 38
EXAONE 3.0 7.8B Instruct LG AI Research LLM 7.8B GGUF 38
Falcon3 Mamba 7B Instruct TII LLM 7.3B GGUF 38
LLM4Decompile 9B V2 LLM4Binary LLM 8.8B GGUF 38
MiniCPM3 4B OpenBMB LLM 4.1B GGUF 38
Mistral 7B Instruct v0.3 Mistral AI LLM 7.3B GGUF 38
Falcon-H1 3B Instruct TII LLM 3.2B GGUF 36
Granite Code 20B Instruct IBM LLM 20B GGUF 36
Hermes 2 Pro Mistral 7B Nous Research LLM 7.2B GGUF 36
Llama 2 70B Chat Meta LLM 69B GGUF 36
OLMo 2 7B Instruct Ai2 LLM 7.3B GGUF 36
Phi-3 Mini 128K Instruct Microsoft LLM 3.8B GGUF 36
Phi-3 Mini 4K Instruct Microsoft LLM 3.8B GGUF 36
Qwen2.5 Coder 3B Instruct Alibaba LLM 3.1B GGUF 36
Qwen2.5-Math 7B Instruct Alibaba LLM 7.6B GGUF 36
Starling LM 7B Beta Nexusflow LLM 7.2B GGUF 36
Yi 1.5 9B Chat 01.AI LLM 8.8B GGUF 36
Llama 3.2 3B Instruct Meta LLM 3.2B GGUF 35
OpenChat 3.5 (0106) OpenChat LLM 7.2B GGUF 35
Aya 23 8B Cohere LLM 8.0B GGUF 34
CodeGemma 7B Google LLM 8.5B GGUF 34
DeepSeek Coder 6.7B Instruct DeepSeek LLM 6.7B GGUF 34
Falcon 180B Chat TII LLM 180B GGUF 34
Mathstral 7B Mistral AI LLM 7.3B GGUF 34
Mistral 7B Instruct v0.2 Mistral AI LLM 7.2B GGUF 34
Nous Hermes 2 Mistral 7B DPO Nous Research LLM 7.2B GGUF 34
OpenChat 3.5 (1210) OpenChat LLM 7.2B GGUF 34
Qwen1.5 14B Chat Alibaba LLM 14B GGUF 34
Qwen2.5 3B Instruct Alibaba LLM 3.1B GGUF 34
Qwen2.5-VL 3B Instruct Alibaba LLM 3.8B GGUF 34
Granite Code 8B Instruct (128K) IBM LLM 8.1B GGUF 32
Hermes 3 Llama 3.2 3B Nous Research LLM 3.2B GGUF 32
InternLM2 Math Plus 7B Shanghai AI Lab LLM 7.7B GGUF 32
LLM4Decompile 6.7B V2 LLM4Binary LLM 6.7B GGUF 32
OpenHermes 2.5 Mistral 7B Teknium LLM 7.2B GGUF 32
StarCoder2 15B (base) BigCode LLM 16B GGUF 32
Starling LM 7B Alpha Berkeley LLM 7.2B GGUF 32
Code Llama 13B Instruct Meta LLM 13B GGUF 30
EXAONE 3.5 2.4B LG AI Research LLM 2.4B GGUF 30
Falcon 3 3B Instruct TII LLM 3.2B GGUF 30
Falcon Mamba 7B Instruct TII LLM 7.3B GGUF 30
Granite 3.2 2B Instruct IBM LLM 2.5B GGUF 30
Granite 3.3 2B IBM LLM 2.5B GGUF 30
Mistral 7B Instruct v0.1 Mistral AI LLM 7.2B GGUF 30
Qwen2.5-Omni 3B Alibaba LLM 5.5B GGUF 30
Qwen3 1.7B Alibaba LLM 2.0B GGUF 30
SQLCoder 7B v2 Defog LLM 6.7B GGUF 30
Gemma 1.1 7B IT Google LLM 8.5B GGUF 28
Gemma 2 2B Google LLM 2.6B GGUF 28
Granite 3.1 2B Instruct IBM LLM 2.5B GGUF 28
Neural Chat 7B v3.3 Intel LLM 7.2B GGUF 28
Orca 2 13B Microsoft LLM 13B GGUF 28
StableLM 2 12B Chat Stability AI LLM 12B GGUF 28
Yi 1.5 6B Chat 01.AI LLM 6.1B GGUF 28
Baichuan 2 13B Chat Baichuan LLM 14B GGUF 26
DeepScaleR 1.5B Preview Agentica LLM 1.8B GGUF 26
DeepSeek MoE 16B Chat DeepSeek LLM 16B (2.8B active) GGUF 26
Falcon-H1 1.5B Instruct TII LLM 1.6B GGUF 26
Gemma 7B IT Google LLM 8.5B GGUF 26
Granite 3.0 2B Instruct IBM LLM 2.6B GGUF 26
Granite Vision 3.2 2B IBM LLM 3.0B GGUF 26
Llama 2 13B Chat Meta LLM 13B GGUF 26
OLMoE 1B-7B Instruct Ai2 LLM 6.9B (1.3B active) GGUF 26
Qwen1.5 7B Chat Alibaba LLM 7.7B GGUF 26
Qwen2.5 Coder 1.5B Instruct Alibaba LLM 1.5B GGUF 26
StarCoder 15B BigCode LLM 16B GGUF 26
WizardMath 7B v1.1 WizardLM LLM 7.2B GGUF 26
Zephyr 7B Beta Hugging Face LLM 7.2B GGUF 26
Code Llama 7B Instruct Meta LLM 6.7B GGUF 24
Qwen2-VL 2B Instruct Alibaba LLM 2.2B GGUF 24
Qwen2.5 1.5B Instruct Alibaba LLM 1.5B GGUF 24
SmolVLM2 2.2B Instruct Hugging Face LLM 2.3B GGUF 24
StarCoder2 7B BigCode LLM 7.2B GGUF 24
DeepSeek R1 Distill Qwen 1.5B DeepSeek LLM 1.8B GGUF 22
Llama 3.2 1B Instruct Meta LLM 1.2B GGUF 22
Nemotron Mini 4B Instruct NVIDIA LLM 4.2B GGUF 22
Orca 2 7B Microsoft LLM 6.7B GGUF 22
SmolVLM 2.2B Instruct Hugging Face LLM 2.3B GGUF 22
WizardLM 13B v1.2 WizardLM LLM 13B GGUF 22
Baichuan 2 7B Chat Baichuan LLM 7.5B GGUF 20
Gemma 3 1B Google LLM 1.0B GGUF 20
Granite 3.1 3B-A800M Instruct IBM LLM 3.3B (0.8B active) GGUF 20
Granite Code 3B Instruct (128K) IBM LLM 3.5B GGUF 20
Llama 2 7B Chat Meta LLM 6.7B GGUF 20
Qwen2.5-Math 1.5B Instruct Alibaba LLM 1.5B GGUF 20
SmolLM2 1.7B Instruct Hugging Face LLM 1.7B GGUF 20
Stable Code Instruct 3B Stability AI LLM 2.8B GGUF 20
Vicuna 13B v1.5 LMSYS LLM 13B GGUF 20
Yi 6B Chat 01.AI LLM 6.1B GGUF 20
DeepSeek LLM 7B Chat DeepSeek LLM 6.9B GGUF 18
Granite 3.0 3B-A800M Instruct IBM LLM 3.4B (0.8B active) GGUF 18
InternLM2.5 1.8B Chat Shanghai AI Lab LLM 1.9B GGUF 18
StarCoder2 3B BigCode LLM 3.0B GGUF 18
Falcon 3 1B Instruct TII LLM 1.7B GGUF 16
Falcon 40B Instruct TII LLM 42B GGUF 16
LLaVA 1.5 7B LLaVA LLM 7.1B GGUF 16
Phi-2 2.7B Microsoft LLM 2.8B GGUF 16
Qwen2 1.5B Instruct Alibaba LLM 1.5B GGUF 16
StableLM Zephyr 3B Stability AI LLM 2.8B GGUF 16
Yi Coder 1.5B Chat 01.AI LLM 1.5B GGUF 16
CodeGemma 2B Google LLM 2.5B GGUF 14
Falcon-H1 0.5B Instruct TII LLM 0.5B GGUF 14
OLMo 2 1B Instruct Ai2 LLM 1.5B GGUF 14
Qwen3 0.6B Alibaba LLM 0.8B GGUF 14
SmolLM 1.7B Instruct Hugging Face LLM 1.7B GGUF 14
Vicuna 7B v1.5 LMSYS LLM 6.7B GGUF 14
DeepSeek Coder 1.3B Instruct DeepSeek LLM 1.4B GGUF 12
Gemma 2B IT Google LLM 2.5B GGUF 12
LLM4Decompile 1.3B V2 LLM4Binary LLM 1.4B GGUF 12
Qwen2.5 0.5B Instruct Alibaba LLM 0.5B GGUF 10
SmolVLM 500M Instruct Hugging Face LLM 0.5B GGUF 10
StableLM 2 1.6B Chat Stability AI LLM 1.6B GGUF 10
StableLM 2 Zephyr 1.6B Stability AI LLM 1.6B GGUF 10
Qwen2.5 Coder 0.5B Instruct Alibaba LLM 0.5B GGUF 8
SmolLM2 360M Instruct Hugging Face LLM 0.4B GGUF 8
Falcon 7B Instruct TII LLM 7.2B GGUF 6
Qwen2 0.5B Instruct Alibaba LLM 0.5B GGUF 6
SmolVLM 256M Instruct Hugging Face LLM 0.3B GGUF 6
TinyLlama 1.1B Chat TinyLlama LLM 1.1B GGUF 6
SmolLM 360M Instruct Hugging Face LLM 0.4B GGUF 5
SmolLM2 135M Instruct Hugging Face LLM 0.1B GGUF 4
SmolLM 135M Instruct Hugging Face LLM 0.1B GGUF 2

Alternatives

Which app should I use?

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?