Downloads · 30 days
58
15% of all-time downloads
MarsupialAI/Yi-6B-200k-v2_GGUF
Yi-6B-200k-v2_GGUF is a machine learning model from MarsupialAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
GGUFs for Yi 6b 200k v2: https://huggingface.co/01-ai/Yi-6B-200K
Downloads · 30 days
58
15% of all-time downloads
All-time downloads
375
Public
Repo size
44.5 GB
Likes
2
Public
Click a slice to open those files.
.gguf34.5 GB · 100%
From the Hugging Face model README
GGUFs for Yi 6b 200k v2: https://huggingface.co/01-ai/Yi-6B-200K
This is the 24/03/07 updated version with enhanced long-context performance. From their notes:
The long text capability of the Yi-34B-200K has been enhanced. In the "Needle-in-a-Haystack" test, the Yi-34B-200K's performance is improved by 10.5%, rising from 89.3% to an impressive 99.8%. We continue to pretrain the model on 5B tokens long-context data mixture and demonstrate a near-all-green performance.
It has been confirmed that the 6b version was similarly updated here: https://huggingface.co/01-ai/Yi-6B-200K/discussions/6