Downloads · 30 days
99
16% of all-time downloads
marin-32b-base-GGUF
laion/marin-32b-base-GGUF
marin-32b-base-GGUF is a machine learning model from laion. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quantizations of marin-community/marin-32b-base, a 32B dense base model (Qwen3 architecture).
All-time downloads
606
Public
Repo size
104 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf104 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026
- SHA
- e425040b
Base models
Model card
From the Hugging Face model README
marin-32b-base-GGUF
GGUF quantizations of marin-community/marin-32b-base,
a 32B dense base model (Qwen3 architecture).
These were produced with llama.cpp
(convert_hf_to_gguf.py → f16 GGUF → llama-quantize).
Available quantizations
| File | Quant | Notes |
|---|---|---|
marin-32b-base-Q4_K_M.gguf | Q4_K_M | 4-bit, medium — good size/quality balance (recommended default) |
marin-32b-base-Q5_K_M.gguf | Q5_K_M | 5-bit, medium — higher quality, larger |
marin-32b-base-Q6_K.gguf | Q6_K | 6-bit — near-lossless |
marin-32b-base-Q8_0.gguf | Q8_0 | 8-bit — effectively lossless vs f16 |
Source
- Base model:
marin-community/marin-32b-base(Apache-2.0) - Architecture: Qwen3 (
Qwen3ForCausalLM), 64 layers, hidden 5120, vocab 128256 - This is a base (non-instruct) model; there is no chat template.
Usage (llama.cpp)
./llama-cli -m marin-32b-base-Q4_K_M.gguf -p "Your prompt here"
- License
- apache-2.0
- Languages
- en
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026