Downloads · 30 days
236
10% of all-time downloads
relay-v0.1-Mistral-Nemo-2407-GGUF
danlou/relay-v0.1-Mistral-Nemo-2407-GGUF
relay-v0.1-Mistral-Nemo-2407-GGUF is a text generation model from danlou. Use it when you need the model to write or continue text. The card lists the license as cc-by-nc-4.0.
<img src="https://cdn-uploads.huggingface.co/production/uploads/60f808c5c1adf9100f1f263c/rNGTfSfFWyWc9mEgyxTGL.png" width="800"/
All-time downloads
2.3K
Public
Repo size
49.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf49.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Dec 4, 2024
- Updated
- Dec 14, 2024
- SHA
- b73e6b5a
Try a prompt
Base models
Model card
From the Hugging Face model README
📟 Relay v0.1 (Mistral Nemo 2407)
<img src="https://cdn-uploads.huggingface.co/production/uploads/60f808c5c1adf9100f1f263c/rNGTfSfFWyWc9mEgyxTGL.png" width="800"/>This model page includes GGUF versions of relay-v0.1-Mistral-Nemo-2407. For more details about this model, please see that model page.
Note: If you have access to a CUDA GPU, it's highly recommended you use the main version (HF) of the model with the relaylm.py script, which supports better use of commands (e.g., system messages). The relaylm.py script also supports 4bit and 8bit bitsandbytes quants.
Custom Preset for LM Studio
To use these GGUF files with LM Studio, you should use this preset configuration. Relay models use ChatML, but not standard roles and system prompts.
After you select and download the GGUF version you want to use:
- Go to the
My Modelstab. - Click the button with the template name for the model (e.g., ChatML).
- Click
Import Preset from file..., and select the file. - Confirm that the model is set to use the relay preset (see screenshot below):
- Task
- Text Generation
- License
- cc-by-nc-4.0
- Created
- Dec 4, 2024
- Updated
- Dec 14, 2024