Downloads · 30 days
55
3% of all-time downloads
EXAONE-3.5-2.4B-Instruct-GGUF
mobilint/EXAONE-3.5-2.4B-Instruct-GGUF
EXAONE-3.5-2.4B-Instruct-GGUF is a text generation model from mobilint. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
<p align="center" <a href="https://mobilint.com"<img src="https://huggingface.co/mobilint/Llama-3.1-8B-Instruct/resolve/main/mobilintlogo.png" width="400"/</a </p
All-time downloads
2.1K
Public
Repo size
3.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.mxq1.4 GB · 57%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Model type
- mobilint-exaone
- Access
- Public
- Created
- Mar 26, 2026
- Updated
- Jun 29, 2026
- SHA
- 26a75f32
Try a prompt
Base models
Model card
From the Hugging Face model README
<p align="center">
<a href="https://mobilint.com"><img src="https://huggingface.co/mobilint/Llama-3.1-8B-Instruct/resolve/main/mobilint_logo.png" width="400"/></a>
</p>
EXAONE 3.5 2.4B Instruct — GGUF + MXQ for llama-cli-mblt
This repository provides EXAONE 3.5 2.4B Instruct compiled and optimized for Mobilint NPU hardware, packaged for use with llama.cpp-mblt.
Branches
| Branch | Contents | Description |
|---|---|---|
main | Body model only | Standard autoregressive decoding |
eagle3 | Body + FC + Draft models | EAGLE3 speculative decoding (~2-4x faster) |
Quick Start
# Simple decoding
llama-cli-mblt -hf mobilint/EXAONE-3.5-2.4B-Instruct-GGUF -p "Hello!" -n 128
# EAGLE3 speculative decoding
llama-cli-mblt -hf mobilint/EXAONE-3.5-2.4B-Instruct-GGUF --eagle3 -p "Hello!" -n 128
# Interactive chat
llama-cli-mblt -hf mobilint/EXAONE-3.5-2.4B-Instruct-GGUF --eagle3
Files
main branch
| File | Size | Description |
|---|---|---|
exaone-3.5-2.4b-instruct-vocab.gguf | 4.0 MB | Tokenizer (vocab-only GGUF) |
target_emb.bin | 1.0 GB | Body embedding weights (float32) |
EXAONE-3.5-2.4B-Instruct.mxq | 1.4 GB | Body model for NPU |
config.json | — | Model configuration |
eagle3 branch (adds)
| File | Size | Description |
|---|---|---|
single_Fc_EXAONE-3.5-2.4B-Instruct.mxq | 19 MB | FC dimension converter model |
Draft_EXAONE-3.5-2.4B-Instruct.mxq | 87 MB | EAGLE3 draft model |
draft_emb.bin | 1.0 GB | Draft embedding weights |
d2t.bin | 250 KB | Draft-to-target vocabulary mapping |
About
This model is compiled and optimized for Mobilint NPU hardware. It is intended to be used with llama-cli-mblt from llama.cpp-mblt.
- Task
- Text Generation
- Library
- gguf
- Type
- mobilint-exaone
- License
- other
- Created
- Mar 26, 2026
- Updated
- Jun 29, 2026