Downloads · 30 days
43
0% of all-time downloads
airoboros-3_1-yi-34b-200k
bhenrym14/airoboros-3_1-yi-34b-200k
airoboros-3_1-yi-34b-200k is a text generation model from bhenrym14. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is larryvrh/Yi-34B-200K-Llamafied, with instruction tuning performed with Jon Durbin's jondurbin/airoboros-3.1 dataset. That base model is 01-ai/Yi-34B-200k, but using llama2 model definitions and tokenizer to re…
All-time downloads
26.7K
Public
Parameters
34.4B
68.8 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors68.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Nov 27, 2023
- Updated
- Nov 27, 2023
- SHA
- 87d9b8f0
Try a prompt
Datasets
Model card
From the Hugging Face model README
Instruction tune of Yi-34b-200k with Airoboros-3.1 (fp16)
Overview
This is larryvrh/Yi-34B-200K-Llamafied, with instruction tuning performed with Jon Durbin's jondurbin/airoboros-3.1 dataset. That base model is 01-ai/Yi-34B-200k, but using llama2 model definitions and tokenizer to remove any remote code requirements.
This is a (merged) QLoRA fine-tune (rank 64).
The finetune was performed with 1x RTX 6000 Ada (~80 hours to this checkpoint). Prompts were truncated to 4096 tokens (for speed and VRAM headroom).
I have done very little testing with this model, so feedback on real world performance is appreciated!
How to Use
Use as you would any other Hugging Face fp16 llama-2 model.
Prompting:
Model was trained with llama-2 chat prompt format. See jondurbin/airoboros-l2-13b-3.1.1 model card for details.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Nov 27, 2023
- Updated
- Nov 27, 2023