Downloads · 30 days
4
15% of all-time downloads
Lumimaid-v02-70B-3.8BPW-6H-Exl2
Blackroot/Lumimaid-v02-70B-3.8BPW-6H-Exl2
Lumimaid-v02-70B-3.8BPW-6H-Exl2 is a machine learning model from Blackroot. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quantized version of <https://huggingface.co/NeverSleep/Lumimaid-v0.2-70B 3.8 BPW weights with a 6 BPW head
All-time downloads
27
Public
Repo size
35.4 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors35.4 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Aug 5, 2024
- Updated
- Aug 5, 2024
- SHA
- 5ffd0db4
Model card
From the Hugging Face model README
Quantized version of https://huggingface.co/NeverSleep/Lumimaid-v0.2-70B 3.8 BPW weights with a 6 BPW head
The measurement file is included in case you want to run the quant yourself.
- Type
- llama
- Created
- Aug 5, 2024
- Updated
- Aug 5, 2024