Downloads · 30 days
32
23% of all-time downloads
Muse-Glimmer-30B-GPTQ-Int4-sym-G128
mgaruccio/Muse-Glimmer-30B-GPTQ-Int4-sym-G128
Muse-Glimmer-30B-GPTQ-Int4-sym-G128 is a text generation model from mgaruccio. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
GPTQ 4-bit / group-128 / symmetric (descact=false, lmhead=false) of Meta Muse Glimmer 30B. Apache 2.0.
All-time downloads
141
Public
Parameters
29.8B
22.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors22.3 GB · 100%
Parameter types
How the weights are stored.
I3225.2B · 85%
Try a prompt
Base models
Model card
From the Hugging Face model README
Muse Glimmer 30B GPTQ Int4 G128
GPTQ 4-bit / group-128 / symmetric (desc_act=false, lm_head=false) of Meta Muse Glimmer 30B. Apache 2.0.
This is the target for the vLLM-XPU + DFlash B70 recipe. Pair it with Muse-Glimmer-30B-assistant-GPTQ-Int4-sym-G128.
- Quantizer: GPTQModel 7.3.2
- Vision / embeddings / lm_head left unquantized; serve with
--language-model-only - Do not treat a from-scratch requant as bit-identical to these shards
hf download mgaruccio/Muse-Glimmer-30B-GPTQ-Int4-sym-G128 --local-dir ./models/target
- Task
- Text Generation
- Library
- transformers
- Type
- muse_glimmer
- License
- apache-2.0
- Created
- Aug 27, 2026
- Updated
- Aug 27, 2026