Downloads · 30 days
752
6% of all-time downloads
Mistral-Nemo-Instruct-2407-iMat-GGUF
qwp4w3hyb/Mistral-Nemo-Instruct-2407-iMat-GGUF
Mistral-Nemo-Instruct-2407-iMat-GGUF is a text generation model from qwp4w3hyb. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
- needs 8604 & latest master with tekken tokenizer fixes applied - quants done with an importance matrix for improved quantization loss - Quantized ggufs & imatrix from hf bf16, through bf16. safetensors bf16 - gguf b…
All-time downloads
12.7K
Public
Repo size
183 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf159 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Jul 18, 2024
- Updated
- Jul 24, 2024
- SHA
- 4a4f4243
Try a prompt
Base models
Model card
From the Hugging Face model README
Quant Infos
- needs #8604 & latest master with tekken tokenizer fixes applied
- quants done with an importance matrix for improved quantization loss
- Quantized ggufs & imatrix from hf bf16, through bf16.
safetensors bf16 -> gguf bf16 -> quantfor optimal quant loss. - Wide coverage of different gguf quant types from Q_8_0 down to IQ1_S
- experimental custom quant types
_Lwith--output-tensor-type f16 --token-embedding-type f16(same as bartowski's)
- experimental custom quant types
- Imatrix generated with this multi-purpose dataset by bartowski.
./imatrix -m $model_name-bf16.gguf -f calibration_datav3.txt -o $model_name.imatrix
Original Model Card:
TODO
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Jul 18, 2024
- Updated
- Jul 24, 2024