Downloads · 30 days
168
11% of all-time downloads
AlphaMonarch-laser-iMat.GGUF
dranger003/AlphaMonarch-laser-iMat.GGUF
AlphaMonarch-laser-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as cc-by-nc-4.0.
GGUF importance matrix (imatrix) quants for https://huggingface.co/abideen/AlphaMonarch-laser The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration d…
All-time downloads
1.5K
Public
Repo size
33.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf33.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Mar 1, 2024
- Updated
- Mar 1, 2024
- SHA
- d8cbf9b8
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/abideen/AlphaMonarch-laser
The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
AlphaMonarch-laser is a DPO fine-tuned of mlabonne/NeuralMonarch-7B using the argilla/OpenHermes2.5-dpo-binarized-alpha preference dataset but achieves better performance then mlabonne/AlphaMonarch-7B using LaserQLoRA. We have fine-tuned this model only on half of the projections, but have achieved better results as compared to the version released by Maximme Labonne. We have trained this model for 1080 steps.
| Layers | Context | Template |
|---|---|---|
| <pre>32</pre> | <pre>32768</pre> | <pre>[INST] {prompt} [/INST]<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- cc-by-nc-4.0
- Created
- Mar 1, 2024
- Updated
- Mar 1, 2024