Downloads · 30 days
25
3% of all-time downloads
RichardErkhov/MoEMoEKKung_-_Frankenstein-MoE-en-10.7Bx6-gguf
MoEMoEKKung_-_Frankenstein-MoE-en-10.7Bx6-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
25
3% of all-time downloads
All-time downloads
988
Public
Repo size
597 GB
Likes
0
Public
Click a slice to open those files.
.gguf692 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Frankenstein-MoE-en-10.7Bx6 - GGUF
language:
To initialize the gate projection weight of the MoE layer, the H6 trainset was sampled and used. We sampled 400 and selected the final 30 with low PPL.
trufulqa used gpt4 to generate data.
in progress