Downloads · 30 days
18
32% of all-time downloads
openhermes-7b-dpo-AWQ
solidrust/openhermes-7b-dpo-AWQ
openhermes-7b-dpo-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Model creator: amazingvince - Original model: openhermes-7b-dpo
All-time downloads
56
Public
Parameters
7.2B
4.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.2 GB · 100%
Parameter types
How the weights are stored.
I327B · 96%
Try a prompt
Base models
Model card
From the Hugging Face model README
amazingvince/openhermes-7b-dpo AWQ
- Model creator: amazingvince
- Original model: openhermes-7b-dpo
Model Summary
OpenHermes 2.5 Mistral 7B is a state of the art Mistral Fine-tune, a continuation of OpenHermes 2 model, which trained on additional code datasets.
Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite. It did however reduce BigBench benchmark score, but the net gain overall is significant.
Here, we are finetuning openheremes using DPO with various data meant to improve its abilities.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Apr 18, 2024
- Updated
- Sep 3, 2024