Downloads · 30 days
9
4% of all-time downloads
SingularitySynth-12B-AWQ-4bit-g64
tooolz/SingularitySynth-12B-AWQ-4bit-g64
SingularitySynth-12B-AWQ-4bit-g64 is a machine learning model from tooolz. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
https://huggingface.co/Marcjoni/SingularitySynth-12B
All-time downloads
227
Public
Parameters
12.2B
8.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.6 GB · 100%
Parameter types
How the weights are stored.
I3210.9B · 89%
Base models
Model card
From the Hugging Face model README
https://huggingface.co/Marcjoni/SingularitySynth-12B
- quantized using AutoAWQ,
- 4bit
- group_size 64
- zero_point: True
- GEMM
- Type
- mistral
- Created
- Dec 7, 2025
- Updated
- Dec 7, 2025