Downloads · 30 days
16
6% of all-time downloads
solidrust/flammen17-py-DPO-v1-7B-AWQ
flammen17-py-DPO-v1-7B-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Model creator: nbeerbower - Original model: flammen17-py-DPO-v1-7B
Downloads · 30 days
16
6% of all-time downloads
All-time downloads
259
Public
Parameters
7.2B
4.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.2 GB · 100%
How the weights are stored.
I327B · 96%
From the Hugging Face model README

A Mistral 7B LLM built from merging pretrained models and finetuning on Jon Durbin's py-dpo-v0.1.
Finetuned using an A100 on Google Colab. 🙏
Fine-tune a Mistral-7b model with Direct Preference Optimization - Maxime Labonne