Downloads · 30 days
151
9% of all-time downloads
CorticalStack_-_neurotic-crown-clown-7b-tak-stack-dpo-gguf
RichardErkhov/CorticalStack_-_neurotic-crown-clown-7b-tak-stack-dpo-gguf
CorticalStack_-_neurotic-crown-clown-7b-tak-stack-dpo-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
1.6K
Public
Repo size
82.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf95.2 GB · 100%
At a glance
- Access
- Public
- Created
- Sep 9, 2024
- Updated
- Sep 9, 2024
- SHA
- c374fc59
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
neurotic-crown-clown-7b-tak-stack-dpo - GGUF
- Model creator: https://huggingface.co/CorticalStack/
- Original model: https://huggingface.co/CorticalStack/neurotic-crown-clown-7b-tak-stack-dpo/
Original model description:
license: apache-2.0 tags:
- dpo base_model:
- CorticalStack/neurotic-crown-clown-7b-ties dataset:
- CorticalStack/tak-stack-dpo
<img src="neurotic-crown-clown-tak-stack.png" alt="Neurotic crown clown tak stack logo" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
neurotic-crown-clown-7b-tak-stack-dpo
neurotic-crown-clown-7b-tak-stack-dpo is a DPO fine-tuned version of CorticalStack/neurotic-crown-clown-7b-ties using the CorticalStack/tak-stack-dpo dataset.
LoRA
- r: 32
- LoRA alpha: 32
- LoRA dropout: 0.05
Training arguments
- Batch size: 4
- Gradient accumulation steps: 4
- Optimizer: paged_adamw_32bit
- Max steps: 100
- Learning rate: 5e-05
- Learning rate scheduler type: cosine
- Beta: 0.1
- Max prompt length: 1024
- Max length: 1536
- Created
- Sep 9, 2024
- Updated
- Sep 9, 2024