Downloads · 30 days
16
29% of all-time downloads
gpt4all_dpo_instruct
Z3R6X/gpt4all_dpo_instruct
gpt4all_dpo_instruct is a text generation model from Z3R6X. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Question answering model finetuned from GPT4All-J v1.3 with Direct Preference Optimization. \ Dataset: Dahoas/instruct-synthetic-prompt-responses.
All-time downloads
55
Public
Repo size
12.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin12.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- gptj
- Access
- Public
- Created
- Mar 10, 2024
- Updated
- Apr 19, 2024
- SHA
- 2ace3112
Try a prompt
Model card
From the Hugging Face model README
Question answering model finetuned from GPT4All-J v1.3 with Direct Preference Optimization.
Dataset: Dahoas/instruct-synthetic-prompt-responses.
The model was finetuned with the following promt:
"Answer the following question in context:\n\nQuestion: " + samples["prompt"] + " Answer: "
It should be benefical to use the same or a similar prompt for inference.
An increase in performance compared to GPT4All-J v1.3 was observed when using two-shot Chain-of-Thought prompting.
| HellaSwag | WinoGrande | BooLQ | ARC-c |
|---|---|---|---|
| 62.37% | 63.3% | 65.2% | 32.76% |
- Task
- Text Generation
- Library
- transformers
- Type
- gptj
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Mar 10, 2024
- Updated
- Apr 19, 2024