Downloads · 30 days
21
7% of all-time downloads
Undi95/Toppy-Mix-4x7B
Toppy-Mix-4x7B is a text generation model from Undi95. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This repo contains fp16 files of Toppy-Mix-4x7B.
Downloads · 30 days
21
7% of all-time downloads
All-time downloads
318
Public
Parameters
24.2B
48.3 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors48.3 GB · 100%
From the Hugging Face model README
This repo contains fp16 files of Toppy-Mix-4x7B.
This project was originaly a request from BlueNipples : link
The difference with the OG Toppy-M is the addition of Noromaid with the 3 models used to do Toppy-M, to have all the model as Expert in this MoE model, and not just merged one into one.
WARNING: ALL THE "K" GGUF QUANT OF MIXTRAL MODELS SEEMS TO BE BROKEN, PREFER Q4_0, Q5_0 or Q8_0!
<!-- description end --> <!-- description start -->Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
If you want to support me, you can here.