Downloads · 30 days
114
15% of all-time downloads
local-llm-gguf
DKTechin/local-llm-gguf
local-llm-gguf is a machine learning model from DKTechin. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Files loaded by the on-device assistant of the KakaoWork desktop app, re-uploaded byte-identical from their upstream repositories. The app needs a location whose bytes do not move under it; this repository is that loc…
All-time downloads
755
Public
Repo size
12.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf12.5 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 5, 2026
- Updated
- Aug 5, 2026
- SHA
- c66a18d3
Model card
From the Hugging Face model README
local-llm-gguf — weight mirror
Files loaded by the on-device assistant of the KakaoWork desktop app, re-uploaded byte-identical from their upstream repositories. The app needs a location whose bytes do not move under it; this repository is that location. Nothing here is our own work.
Every upstream repository below is Apache-2.0 and ungated. Please prefer the upstream repositories — they hold the other quantizations and the model cards.
Files
| File | Size | Upstream |
|---|---|---|
gemma-4-E2B_q4_0-it.gguf | 3.35 GB | google/gemma-4-E2B-it-qat-q4_0-gguf |
gemma-4-E4B_q4_0-it.gguf | 5.15 GB | google/gemma-4-E4B-it-qat-q4_0-gguf |
Qwen3.5-2B-Q4_K_M.gguf | 1.28 GB | unsloth/Qwen3.5-2B-GGUF |
Qwen3.5-4B-Q4_K_M.gguf | 2.74 GB | unsloth/Qwen3.5-4B-GGUF |
kanana-2-3b-instruct-Q4_K_M.gguf is not here — it is our own conversion and
lives in DKTechin/kanana.
Credits
The models are by their creators — Google (Gemma 4) and Alibaba/Qwen (Qwen3.5) — and the GGUF builds are by the repositories listed above. Their licenses and terms of use apply to these copies unchanged.
If you maintain one of the upstream repositories and would rather this mirror not exist, open a discussion and we will remove it.
- License
- apache-2.0
- Created
- Aug 5, 2026
- Updated
- Aug 5, 2026