Downloads · 30 days
504
6% of all-time downloads
wimmmm/poolside-Laguna-S-2.1-GGUF
poolside-Laguna-S-2.1-GGUF is a machine learning model from wimmmm. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as openmdw-1.1.
This is a GGUF quantization of Poolside's Laguna S 2.1 using an imatrix based on Bartowski's dataset.
Downloads · 30 days
504
6% of all-time downloads
All-time downloads
9K
Public
Repo size
835 GB
Likes
1
Public
Click a slice to open those files.
.gguf835 GB · 100%
From the Hugging Face model README
This is a GGUF quantization of Poolside's Laguna S 2.1 using an imatrix based on Bartowski's dataset.
It was generated with llama.cpp 846e991e plus the changes from PR 25165, which at the time of building included commits up to 54f214a09b8
DFlash draft model is available at wimmmm/poolside-Laguna-S-2.1-DFlash-GGUF
To run with DFlash enabled, you can use the following command line (change quantizations as needed):
llama serve -hf wimmmm/poolside-Laguna-S-2.1-GGUF:Q4_K_M -hfd wimmmm/poolside-Laguna-S-2.1-DFlash-GGUF:Q4_0 --spec-type draft-dflash --spec-draft-n-max 15 -fa on --jinja --port 8000
Have fun!