Downloads · 30 days
436
9% of all-time downloads
adamo1139/magnum-v2-4b-gguf-lowctx
magnum-v2-4b-gguf-lowctx is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
https://github.com/ggerganov/llama.cpp/pull/9141
Downloads · 30 days
436
9% of all-time downloads
All-time downloads
4.8K
Public
Repo size
44.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf44.7 GB · 100%
From the Hugging Face model README
https://github.com/ggerganov/llama.cpp/pull/9141
PR to get long context support for this model in llama.cpp has been merged, so those quants no longer need to be used provided you have a newly compiled llama.cpp build. You can find official long ctx quants here