Downloads · 30 days
884
5% of all-time downloads
Azure_Dusk-v0.2-GGUF-IQ-Imatrix
Lewdiculous/Azure_Dusk-v0.2-GGUF-IQ-Imatrix
Azure_Dusk-v0.2-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for nemo. The card lists the license as apache-2.0.
All-time downloads
16.7K
Public
Repo size
153 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf153 GB · 100%
At a glance
- Library
- nemo
- License
- apache-2.0
- Access
- Public
- Created
- Sep 11, 2024
- Updated
- Sep 12, 2024
- SHA
- 301a01ad
Base models
Model card
From the Hugging Face model README
Model name: <br> Azure_Dusk-v0.2
Description: <br> "Following up on Crimson_Dawn-v0.2 we have Azure_Dusk-v0.2! Training on Mistral-Nemo-Base-2407 this time I've added significantly more data, as well as trained using RSLoRA as opposed to regular LoRA. Another key change is training on ChatML as opposed to Mistral Formatting." <br> – by Author. <br>
As described, use the ChatML prompt format. <br>
[!TIP] Presets: <br> You can use ChatML presets within SillyTavern and adjust from there. <br> Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.
[!NOTE] Original model page: <br> https://huggingface.co/Epiculous/Azure_Dusk-v0.2
Quantized using llama.cpp-b3733: <br>
1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16) 2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)
- Library
- nemo
- License
- apache-2.0
- Created
- Sep 11, 2024
- Updated
- Sep 12, 2024