Downloads · 30 days
27
3% of all-time downloads
TinyLlama-1.1B-orca-gpt4
acalatrava/TinyLlama-1.1B-orca-gpt4
TinyLlama-1.1B-orca-gpt4 is a text generation model from acalatrava. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
997
Public
Repo size
4.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Sep 21, 2023
- Updated
- Sep 21, 2023
- SHA
- 22f9e9db
Try a prompt
Model card
From the Hugging Face model README
<div align="center">
TinyLlama-1.1B
Finetuned with ORCA-GPT4 (chatml format)
</div>This is a fine-tuned version of TinyLlama-1.1B-intermediate-step-240k-503b using the sam-mosaic/orca-gpt4-chatml dataset.
Training
- Method: QLORA
- Quantization: fp16
- Time: 20h on a RTX 4090 (from runpod.io)
- Cost: About $15
- Based on: https://colab.research.google.com/drive/1Zmaceu65d7w4Tcd-cfnZRb6k_Tcv2b8g
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Sep 21, 2023
- Updated
- Sep 21, 2023