Downloads · 30 days
1K
11% of all-time downloads
RemySkye/MiniCPM5-1B-i1-GGUF
MiniCPM5-1B-i1-GGUF is a text generation model from RemySkye. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository contains GGUF format quantizations of the model openbmb/MiniCPM5-1B. These models were generated using llama.cpp with an Importance Matrix (imatrix) - https://gist.github.com/bartowski1182/82ae9b520227…
Downloads · 30 days
1K
11% of all-time downloads
All-time downloads
9K
Public
Repo size
25.2 GB
Likes
2
Public
Click a slice to open those files.
.gguf25.2 GB · 100%
From the Hugging Face model README
This repository contains GGUF format quantizations of the model openbmb/MiniCPM5-1B. These models were generated using llama.cpp with an Importance Matrix (imatrix) - https://gist.github.com/bartowski1182/82ae9b520227f57d79ba04add13d0d0d
The collection includes a total of 26 files:
imatrix.gguf is included for reference or custom useQuantization below 4 bits may result in unacceptably low quality, particularly for a 1B parameter model, which is inherently more sensitive to such compression.