Downloads · 30 days
34
1% of all-time downloads
dolphin-2.9-llama3-8b-AWQ
solidrust/dolphin-2.9-llama3-8b-AWQ
dolphin-2.9-llama3-8b-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations
All-time downloads
4K
Public
Parameters
8B
5.7 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
I327B · 87%
Try a prompt
Base models
Model card
From the Hugging Face model README
cognitivecomputations/dolphin-2.9-llama3-8b AWQ
Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations
Discord: https://discord.gg/8fbBeC7ZGx
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />My appreciation for the sponsors of Dolphin 2.9:
- Crusoe Cloud - provided excellent on-demand 10xL40S node
This model is based on Llama-3-8b, and is governed by META LLAMA 3 COMMUNITY LICENSE AGREEMENT
The base model has 8k context, and the full-weight fine-tuning was with 4k sequence length.
It took 2.5 days on 8x L40S provided by Crusoe Cloud
This model was trained FFT on all parameters, using ChatML prompt template format.
example:
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Apr 21, 2024
- Updated
- Apr 21, 2024