Downloads · 30 days
27
33% of all-time downloads
relay-v0.1-Mistral-Nemo-2407-4bit
danlou/relay-v0.1-Mistral-Nemo-2407-4bit
relay-v0.1-Mistral-Nemo-2407-4bit is a text generation model from danlou. Use it when you need the model to write or continue text. The card lists the license as cc-by-nc-4.0.
<img src="https://cdn-uploads.huggingface.co/production/uploads/60f808c5c1adf9100f1f263c/rNGTfSfFWyWc9mEgyxTGL.png" width="800"/
All-time downloads
82
Public
Parameters
12.4B
8.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.8 GB · 100%
Parameter types
How the weights are stored.
U810.9B · 88%
Try a prompt
Base models
Model card
From the Hugging Face model README
📟 Relay v0.1 (Mistral Nemo 2407): 4-bit (bnb)
<img src="https://cdn-uploads.huggingface.co/production/uploads/60f808c5c1adf9100f1f263c/rNGTfSfFWyWc9mEgyxTGL.png" width="800"/>This model page includes the 4-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.
- Task
- Text Generation
- Type
- mistral
- License
- cc-by-nc-4.0
- Created
- Dec 6, 2024
- Updated
- Dec 14, 2024