Downloads · 30 days
119
8% of all-time downloads
ayoubkirouane/Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf
Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf is a text generation model from ayoubkirouane. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
- [q80 , F16] Quantized version of Mistral-Depth-UP-Scaled-9B
Downloads · 30 days
119
8% of all-time downloads
All-time downloads
1.5K
Public
Repo size
27.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf27.1 GB · 100%
From the Hugging Face model README
GGUF is a file format for storing models for inference with GGML and executors based on GGML. GGUF is a binary format that is designed for fast loading and saving of models, and for ease of reading. Models are traditionally developed using PyTorch or another framework, and then converted to GGUF for use in GGML.
It is a successor file format to GGML, GGMF and GGJT, and is designed to be unambiguous by containing all the information needed to load a model. It is also designed to be extensible, so that new information can be added to models without breaking compatibility.