Downloads · 30 days
16
8% of all-time downloads
Cascade0-159M-DPO-Instruct-V2-0925-GGUF
ARMZyany/Cascade0-159M-DPO-Instruct-V2-0925-GGUF
Cascade0-159M-DPO-Instruct-V2-0925-GGUF is a machine learning model from ARMZyany. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
(i personally advise you to either go for F16, or Q8.) Experimental DPO Pass to see the difference. In some cases, during certain chats, the new DPO actually helps and makes the model feel more chat-y, sort of. For eg…
All-time downloads
194
Public
Repo size
621 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf621 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Sep 28, 2025
- Updated
- Sep 29, 2025
- SHA
- babd7a67
Base models
Model card
From the Hugging Face model README
(i personally advise you to either go for F16, or Q8.)
Cascade0 DPO Instruct V2
Experimental DPO Pass to see the difference.
In some cases, during certain chats, the new DPO actually helps and makes the model feel more chat-y, sort of.
For eg, when asking 'How to make a salad', it responds:
Training info
Done in 2 weeks on a single RTX 4080, the raw pretraining only achieveing 40% of the max 12B tokens, due to potential overfill, reaching only 4.8B tokens.
Max context size is 1512.
SFT was done in two days, while DPO took only 1 day, on a RTX 3060M.
Other small models VS Cascade0-Series
All models are evaluated using LMEval Harness, on the same PC/Settings and GGUF with F16 Quant.
made with LMEval Harness
- License
- apache-2.0
- Languages
- en
- Created
- Sep 28, 2025
- Updated
- Sep 29, 2025