Downloads · 30 days
6
5% of all-time downloads
Nielk38/Qwen3.8-27B-MTP-GGUF-SPLIT
Qwen3.8-27B-MTP-GGUF-SPLIT is a text generation model from Nielk38. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Split GGUF shards of unsloth/Qwen3.8-27B-GGUF, using the current Unsloth Dynamic v3 UD-Q3KXL quantization.
Downloads · 30 days
6
5% of all-time downloads
All-time downloads
113
Public
Repo size
13.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf13.1 GB · 100%
From the Hugging Face model README
Split GGUF shards of unsloth/Qwen3.8-27B-GGUF, using the current Unsloth Dynamic v3 UD-Q3_K_XL quantization.
The original quantized tensors are preserved; this is a split, not a requantization.
| Quantization | Total size | Shards | llama.cpp type |
|---|---|---|---|
Qwen3.8-27B-UD-Q3_K_XL | 13,146,393,824 bytes | 3 | Q3_K - Large |
| File | Bytes | SHA-256 |
|---|---|---|
Qwen3.8-27B-UD-Q3_K_XL-00001-of-00003.gguf | 4,906,066,688 | 7503289f9bf53bd41e5c29bbf6a125eb5744b3ca5842b8224f5763dc07dda3db |
Qwen3.8-27B-UD-Q3_K_XL-00002-of-00003.gguf | 4,890,964,352 | 32a142816d057e24e3bc6a55e6523a081559d3828638805779eeca822d8b0c6a |
Qwen3.8-27B-UD-Q3_K_XL-00003-of-00003.gguf | 3,349,362,784 | 7112823753700a9dfb15289fbbe0006f7c1b301b409cedc0dd9f61549c061291 |
Download all three shards into the same directory:
hf download Nielk38/Qwen3.8-27B-MTP-GGUF-SPLIT \
--include "*.gguf" \
--local-dir ./Qwen3.8-27B-MTP-GGUF-SPLIT
Load only the first shard; llama.cpp discovers the other two automatically:
llama-cli \
-m ./Qwen3.8-27B-MTP-GGUF-SPLIT/Qwen3.8-27B-UD-Q3_K_XL-00001-of-00003.gguf \
-ngl 999 \
-c 8192
The Qwen3.8 checkpoint is MTP-trained. This repository contains the main Q3 GGUF only. The optional standalone MTP draft model and vision projectors can be downloaded from the source GGUF repository.
Qwen3.8-27B-UD-Q3_K_XL.gguf27af057ecb382ddfea5d12837360a8980560e3ed8c2a45ff85e7674ca185ec8eb6cdeab0e617ed9d8018caed0b64380eb2a67a5ellama-gguf-split from llama.cpp b10502 (0adcc3bb5)llama-gguf-split --split --split-max-size 4900M \
Qwen3.8-27B-UD-Q3_K_XL.gguf \
Qwen3.8-27B-UD-Q3_K_XL
Validated locally on 2026-08-19 with llama.cpp b10502 on an AMD Radeon RX 7900 XTX by loading shard 00001 directly. The prompt What is 2+2? Answer with only the numeral. returned 4.
The shards were also merged back with llama-gguf-split --merge. All 866 tensor descriptors and tensor bytes matched the source, with logical tensor SHA-256 2b7efe87386ffa39812f47aac97d431fe1f7706a8733b8cff1833e324e0371f2. The merged container retains llama.cpp's three split.* metadata keys, so its whole-file hash is intentionally different from the unsplit source container.
See SHA256SUMS for machine-readable shard checksums.