Downloads · 30 days
67
0% of all-time downloads
platypus-yi-34b
bhenrym14/platypus-yi-34b
platypus-yi-34b is a text generation model from bhenrym14. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is chargoddard/Yi-34B-Llama, with instruction tuning performed with the garage-bAInd/Open-Platypus dataset. That base model is 01-ai/Yi-34B, but using llama2 model definitions and tokenizer to remove any remote c…
All-time downloads
40.7K
Public
Parameters
34.4B
68.8 GB on disk
Likes
13
Public
Repo makeup
Click a slice to open those files.
.safetensors68.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Nov 15, 2023
- Updated
- Nov 15, 2023
- SHA
- 66abec7c
Try a prompt
Datasets
Model card
From the Hugging Face model README
Instruction tune of Yi-34b with Open-Platypus (fp16)
Overview
This is chargoddard/Yi-34B-Llama, with instruction tuning performed with the garage-bAInd/Open-Platypus dataset. That base model is 01-ai/Yi-34B, but using llama2 model definitions and tokenizer to remove any remote code requirements.
This is a (merged) QLoRA fine-tune (rank 64).
The finetune was performed with 1x RTX 6000 Ada (~18 hours to this checkpoint). It is possible this is rather undertrained, as this checkpoint is at 1 epoch. I began to see some performance degradation after that; more hyperparameter tuning is probably warranted.
How to Use
Use as you would any llama-2 model.
Prompting:
Model was trained with legacy airoboros <2.0 system prompt. See bhenrym14/airoboros-33b-gpt4-1.4.1-lxctx-PI-16384-fp16 model card for details.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Nov 15, 2023
- Updated
- Nov 15, 2023