Downloads · 30 days
6
14% of all-time downloads
Westlake-10.7B-v2-4bit-AWQ
Splice05362/Westlake-10.7B-v2-4bit-AWQ
Westlake-10.7B-v2-4bit-AWQ is a text generation model from Splice05362. Use it when you need the model to write or continue text. It is set up for transformers.
AWQ Quant of https://huggingface.co/froggeric/WestLake-10.7B-v2 by request
All-time downloads
42
Public
Parameters
10.7B
6 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors6 GB · 100%
Parameter types
How the weights are stored.
I3210.5B · 98%
Try a prompt
Model card
From the Hugging Face model README
AWQ Quant of https://huggingface.co/froggeric/WestLake-10.7B-v2 by request
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- May 25, 2024
- Updated
- May 25, 2024