LLMs · LLM4Binary
LLM4Decompile 1.3B V2
- Parameters
- 1.4B
- Architecture
- Dense
- Max context
- 16K tokens
- License
- mit
- Released
- 2024-06
How to run it
- Install PocketPal AI (free) and open it.
- Download LLM4Binary.llm4decompile-1.3b-v2.Q4_K_M.gguf (opens in a new tab) on the device. It goes to Files › Downloads on an iPhone or iPad, or the Downloads folder on Android.
- In PocketPal AI, tap the menu (☰), then Models, then + and Add Local Model, and pick the file.
- Tap Load next to the model and start a chat. It runs on the device, offline.
- Install PocketPal AI (free) and open it.
- Download LLM4Binary.llm4decompile-1.3b-v2.Q4_K_M.gguf (opens in a new tab) on the device. It goes to Files › Downloads on an iPhone or iPad, or the Downloads folder on Android.
- In PocketPal AI, tap the menu (☰), then Models, then + and Add Local Model, and pick the file.
- Tap Load next to the model and start a chat. It runs on the device, offline.
On a mobile device
LLM4Decompile 1.3B V2 is too big for a device like yours: it needs more memory than the device has. Models that run on mobile devices.
Quantized files · GGUF
Works in LM Studio, llama.cpp, Jan and Ollama. No sign-in needed.
huggingface.co/DevQuasar-7/LLM4Binary.llm4decompile-1.3b-v2-GGUF (opens in a new tab)
ollama run hf.co/DevQuasar-7/LLM4Binary.llm4decompile-1.3b-v2-GGUFOriginal weights · Hugging Face
Full-precision files from LLM4Binary, for fine-tuning, vLLM, Transformers.
huggingface.co/LLM4Binary/llm4decompile-1.3b-v2 (opens in a new tab)
Official repo · GitHub
Reference code, inference scripts and docs from LLM4Binary. The weights themselves download from Hugging Face.
github.com/albertan017/LLM4Decompile (opens in a new tab)
git clone https://github.com/albertan017/LLM4DecompileApps that run LLM4Decompile 1.3B V2
Our pick for each kind of computer, assuming the model fits in its memory. Pick your own GPU or device in the Model Finder for an exact answer.
| App | Type | Opens it as | Systems | Engine | Start |
|---|---|---|---|---|---|
| LM Studio | Desktop app | GGUF | macOSWindowsLinux | Open in LM Studio | |
| Ollama | CLI + API | GGUF from Hugging Face | macOSWindowsLinux |
|
|
| llama.cpp | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Jan | Desktop app | GGUF | macOSWindowsLinux | Open in Jan | |
| vLLM | Server | Original weights | WSLWindowsLinux |
|
|
| SGLang | Server | Original weights | WSLWindowsLinux |
|
|
| Docker Model Runner | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Lemonade | Desktop app | GGUF | macOSWindowsLinux |
|
|
| Unsloth Desktop | Desktop app | GGUF | macOSWindowsLinux | Open in Unsloth Desktop | |
| Atomic Chat | Desktop app | GGUF | macOSWindowsLinux | Open in Atomic Chat | |
| GPT4All | Desktop app | GGUF | macOSWindowsLinux | Get GPT4All | |
| KoboldCpp | Desktop app | GGUF | macOSWindowsLinux | Get KoboldCpp | |
| Text Generation WebUI | Desktop app | GGUF | macOSWindowsLinux | Get Text Generation WebUI | |
| llamafile | CLI + API | GGUF | macOSWindowsLinux | Get llamafile | |
| Msty Studio | Desktop app | GGUF | macOSWindowsLinux | Open in Msty Studio | |
| Llama (macOS) | Desktop app | GGUF | macOS | Open in Llama (macOS) | |
| RecurseChat | Desktop app | GGUF | macOS | Open in RecurseChat | |
| node-llama-cpp | Library | GGUF | macOSWindowsLinux | Get node-llama-cpp | |
| PocketPal AI | Mobile app | GGUF | iOSAndroid | App Store Google Play | |
| ChatterUI | Mobile app | GGUF | Android | Download the APK | |
| LLM Farm | Mobile app | GGUF | iOS |
Memory needed
Weights plus KV cache and runtime overhead. Leave a little extra free for the operating system and other apps. Try another context length.
| Quantization | Quality | Weights | Total at 8K context | Total at 16K context | Download |
|---|---|---|---|---|---|
Q2_K |
Low | 0.5 GB | 2.8 GB | 4.4 GB | GGUF (opens in a new tab) |
Q3_K_M |
Low | 0.7 GB | 2.9 GB | 4.5 GB | GGUF (opens in a new tab) |
Q4_K_M |
Good | 0.8 GB | 3.0 GB | 4.6 GB | GGUF (opens in a new tab) |
Q5_K_M |
High | 1.0 GB | 3.2 GB | 4.8 GB | GGUF (opens in a new tab) |
Q6_K |
High | 1.1 GB | 3.3 GB | 4.9 GB | GGUF (opens in a new tab) |
Q8_0 |
Very high | 1.4 GB | 3.6 GB | 5.3 GB | GGUF (opens in a new tab) |
F16 |
Full | 2.7 GB | 4.9 GB | 6.5 GB | GGUF (opens in a new tab) Original weights (opens in a new tab) |
Best hardware for LLM4Decompile 1.3B V2
The least expensive GPU in our catalog that runs it without offloading is the Intel Arc A380 (launch price $139) at Q8_0.
| Quality | Hardware | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GeForce RTX 4060 |
F16 | 5.3 GB / 8.0 GB | 58.0 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking. | Intel Arc B580 |
F16 | 5.5 GB / 12.0 GB | 74.3 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GeForce RTX 3060 12GB |
F16 | 5.5 GB / 12.0 GB | 76.8 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GeForce RTX 4070 SUPER |
F16 | 5.5 GB / 12.0 GB | 108 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking. | Apple M4 (16 GB) |
Q8_0 | 4.5 GB / 10.7 GB | 47.8 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking. | Apple M4 Pro (24 GB) |
F16 | 6.2 GB / 16.1 GB | 50.2 tok/s | Runs great |
| 11Basic quality (D) · 11 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking. | Apple M1 (16 GB) |
Q5_K_M | 4.0 GB / 10.7 GB | 44.1 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking. | AMD Radeon RX 9070 XT |
F16 | 5.7 GB / 16.0 GB | 118 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GeForce RTX 4060 Ti 16GB |
F16 | 5.7 GB / 16.0 GB | 61.4 tok/s | Runs great |
| 12Basic quality (D) · 12 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GeForce RTX 4070 Ti SUPER |
F16 | 5.7 GB / 16.0 GB | 143 tok/s | Runs great |
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.









