Downloads · 30 days
39
6% of all-time downloads
Anubis-70B-v1.1-AWQ
Sinensis/Anubis-70B-v1.1-AWQ
Anubis-70B-v1.1-AWQ is a text generation model from Sinensis. Use it when you need the model to write or continue text. It is set up for transformers.
quantizationconfig: bits: 4 groupsize: 128 quantmethod: awq version: gemm zeropoint: true
All-time downloads
656
Public
Parameters
70.6B
39.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors39.8 GB · 100%
Parameter types
How the weights are stored.
I3268.5B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
AWQ quantization of TheDrummer/Anubis-70B-v1.1
quantization_config:
bits: 4
group_size: 128
quant_method: awq
version: gemm
zero_point: true
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 19, 2025
- Updated
- Jul 19, 2025