Downloads · 30 days
23
6% of all-time downloads
Reiterate3680/Hollow-Tail-V1-12B-GGUF
Hollow-Tail-V1-12B-GGUF is a text generation model from Reiterate3680. Use it when you need the model to write or continue text. The card lists the license as other.
Really nice performing merge for me. Try the template from the merge creator or the following:
Downloads · 30 days
23
6% of all-time downloads
All-time downloads
394
Public
Repo size
18.4 GB
Likes
1
Public
Click a slice to open those files.
.gguf18.4 GB · 100%
From the Hugging Face model README
Really nice performing merge for me. Try the template from the merge creator or the following:
<[start_system]>
System<[END]>
<[start_user]>
User<[END]>
<[start_assistant]>
Model response<[END]>
L quants (or more), for fun/testing, probably prefer bartowski or mradermacher's quants if available
Original Model: https://huggingface.co/starble-dev/Hollow-Tail-V1-12B
Made with a modified version of https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
Q2_K_L, Q4_K_L, Q5_K_L, Q6_K_L, are using Q_8 output tensors and token embeddings. imatrix is done using bartowski's imatrix dataset