Downloads · 30 days
277
2% of all-time downloads
QuantFactory/Lyra4-Gutenberg-12B-GGUF
Lyra4-Gutenberg-12B-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
277
2% of all-time downloads
All-time downloads
11.3K
Public
Repo size
111 GB
Likes
6
Public
Click a slice to open those files.
.gguf111 GB · 100%
From the Hugging Face model README
This is quantized version of nbeerbower/Lyra4-Gutenberg-12B created using llama.cpp
Sao10K/MN-12B-Lyra-v4 finetuned on jondurbin/gutenberg-dpo-v0.1.
ORPO Finetuned using an RTX 3090 + 4060 Ti for 3 epochs.