Downloads · 30 days
9
15% of all-time downloads
phi-3.1-qlora-blend-dpo
ndavidson/phi-3.1-qlora-blend-dpo
phi-3.1-qlora-blend-dpo is a text generation model from ndavidson. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
phi-3.1-qlora-blend-dpo is a merge of the following models using mergekit: ndavidson/phi-3.1-qlorablend-1 ndavidson/phi-3.1-qlorablend-0
All-time downloads
62
Public
Parameters
3.8B
7.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- phi3
- Access
- Public
- Created
- Jul 10, 2024
- Updated
- Jul 10, 2024
- SHA
- 98c80c12
Try a prompt
Model card
From the Hugging Face model README
phi-3.1-qlora-blend-dpo
phi-3.1-qlora-blend-dpo is a merge of the following models using mergekit:
🧩 Configuration
models:
- model: microsoft/Phi-3-mini-4k-instruct
# no parameters necessary for base model
- model: ndavidson/phi-3.1-qlorablend-1
parameters:
density: 0.5
weight: 0.5
- model: ndavidson/phi-3.1-qlorablend-0
parameters:
density: 0.5
weight: 0.5
merge_method: ties
base_model: microsoft/Phi-3-mini-4k-instruct
parameters:
normalize: true
dtype: float16
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- License
- apache-2.0
- Created
- Jul 10, 2024
- Updated
- Jul 10, 2024