Downloads · 30 days
53
8% of all-time downloads
L3.1-8B-komorebi-GGUF
QuantFactory/L3.1-8B-komorebi-GGUF
L3.1-8B-komorebi-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as llama3.
All-time downloads
693
Public
Repo size
72.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf72.7 GB · 100%
At a glance
- Library
- transformers
- License
- llama3
- Access
- Public
- Created
- Sep 17, 2024
- Updated
- Sep 17, 2024
- SHA
- b4c3c64e
Datasets
Model card
From the Hugging Face model README
QuantFactory/L3.1-8B-komorebi-GGUF
This is quantized version of crestf411/L3.1-8B-komorebi created using llama.cpp
Original Model Card
This is a model based on a multi-phase process using KTO fine tuning using the jondurbin gutenberg approach, that results in 3 separate LoRAs which are merged in sequence.
The resulting model is exhibiting a significant decrease in Llama 3.1 slop outputs.
Experimental. Please give feedback. Begone if you demand perfection.
I did most of my testing with temp 1.4, min-p 0.15, DRY 0.8. I also did play with enabling XTC with threshold 0.1, prob 0.50.
As context grows, you may want to bump temp and min-p and maybe even DRY.
- Library
- transformers
- License
- llama3
- Created
- Sep 17, 2024
- Updated
- Sep 17, 2024