Downloads · 30 days
44
3% of all-time downloads
gguf-Mixnueza-6x32M-MoE
Felladrin/gguf-Mixnueza-6x32M-MoE
gguf-Mixnueza-6x32M-MoE is a machine learning model from Felladrin. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF version of Isotonic/Mixnueza-6x32M-MoE.
All-time downloads
1.7K
Public
Repo size
505 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf505 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 2, 2024
- Updated
- Apr 20, 2024
- SHA
- 5d07d21d
Base models
Model card
From the Hugging Face model README
GGUF version of Isotonic/Mixnueza-6x32M-MoE.
It was not possible to quantize the model, so only the F16 and F32 GGUF files are available.
Try it with llama.cpp
brew install ggerganov/ggerganov/llama.cpp
llama-cli \
--hf-repo Felladrin/gguf-Mixnueza-6x32M-MoE \
--model Mixnueza-6x32M-MoE.F32.gguf \
--random-prompt \
--temp 1.3 \
--dynatemp-range 1.2 \
--top-k 0 \
--top-p 1 \
--min-p 0.1 \
--typical 0.85 \
--mirostat 2 \
--mirostat-ent 3.5 \
--repeat-penalty 1.1 \
--repeat-last-n -1 \
-n 256
- License
- apache-2.0
- Created
- Apr 2, 2024
- Updated
- Apr 20, 2024