Downloads · 30 days
108
32% of all-time downloads
Hemmingway-1-AutoRound-W4G128
groxaxo/Hemmingway-1-AutoRound-W4G128
Hemmingway-1-AutoRound-W4G128 is a text generation model from groxaxo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
4-bit, group-size-128 AutoRound quantization of Altworld/Hemmingway-1, a 27B-parameter fine-tune of Qwen3.8-27B. This repository is an independent quantization, not the original model release. See the original model c…
All-time downloads
338
Public
Parameters
5.8B
18.6 GB on disk
Likes
2
Trending 1
Repo makeup
Click a slice to open those files.
.safetensors18.6 GB · 100%
Parameter types
How the weights are stored.
I323.1B · 49%
Try a prompt
Base models
Model card
From the Hugging Face model README
Hemmingway-1 — AutoRound W4G128
4-bit, group-size-128 AutoRound quantization of Altworld/Hemmingway-1, a 27B-parameter fine-tune of Qwen3.8-27B. This repository is an independent quantization, not the original model release. See the original model card for training, intended use, and benchmark information.
Quantization: AutoRound 0.15.1, bits=4, group_size=128, packing_format=auto_round:auto_awq, seqlen=1024, nsamples=64, iters=50. Certain layers remain in higher precision, as specified in quantization_config.json.
The included six-shard weight index and auxiliary model_extra_tensors.safetensors are needed together. Approximate download size: 18.65 GB (17.37 GiB). This is a quantization of an existing fine-tuned model, not a new fine-tuning run. Inference compatibility depends on a Transformers/AutoRound stack supporting this model architecture and quantization format; no inference benchmark or quality claim is made here.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_5_text
- License
- apache-2.0
- Created
- Sep 24, 2026
- Updated
- Sep 24, 2026