Downloads · 30 days
51
15% of all-time downloads
Mistral-Gutenberg-Doppel-7B-FFT
nbeerbower/Mistral-Gutenberg-Doppel-7B-FFT
Mistral-Gutenberg-Doppel-7B-FFT is a text generation model from nbeerbower. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
345
Public
Parameters
7.2B
14.5 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Nov 18, 2024
- Updated
- Nov 18, 2024
- SHA
- 57358764
Try a prompt
Base models
Model card
From the Hugging Face model README
Mistral-Gutenberg-Doppel-7B-FFT
mistralai/Mistral-7B-Instruct-v0.2 finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
This is a full finetune rather than my usual QLoRA tunes. Mostly for learning purposes.
Method
ORPO tuned with 4x A100 for 2 epochs.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Nov 18, 2024
- Updated
- Nov 18, 2024