Downloads · 30 days
50
3% of all-time downloads
Lyra_Gutenbergs-Twilight_Magnum-12B-GGUF
QuantFactory/Lyra_Gutenbergs-Twilight_Magnum-12B-GGUF
Lyra_Gutenbergs-Twilight_Magnum-12B-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
All-time downloads
1.7K
Public
Repo size
111 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf111 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Aug 27, 2024
- Updated
- Aug 27, 2024
- SHA
- 8bb2b110
Model card
From the Hugging Face model README
QuantFactory/Lyra_Gutenbergs-Twilight_Magnum-12B-GGUF
This is quantized version of Nitral-AI/Lyra_Gutenbergs-Twilight_Magnum-12B created using llama.cpp
Original Model Card
Original Models:
Anthracite - https://huggingface.co/anthracite-org/magnum-v2.5-12b-kto
Nbeerbower - https://huggingface.co/nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
Epiculous - https://huggingface.co/Epiculous/Violet_Twilight-v0.1
All credit goes to the original model authors, this is just a double back slerp merge (config in repo) i did while commiting many various dataset war-crimes. I mean... ShareGPT Formaxxing.
Other Notes: Text completion preset in repo - Instruct format works with either Mistral or ChatML. If using ST with chatML add ["<|im_end|"] to custom stopping strings to prevent chatml eos tokens from leaking into chat.
- License
- other
- Languages
- en
- Created
- Aug 27, 2024
- Updated
- Aug 27, 2024