Downloads · 30 days
146
4% of all-time downloads
Yi-34B-200K-RPMerge-iMat.GGUF
brucethemoose/Yi-34B-200K-RPMerge-iMat.GGUF
Yi-34B-200K-RPMerge-iMat.GGUF is a machine learning model from brucethemoose. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
See the main model card: https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge
All-time downloads
3.8K
Public
Repo size
138 GB
Likes
10
Public
Repo makeup
Click a slice to open those files.
.gguf138 GB · 100%
At a glance
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Feb 10, 2024
- Updated
- Feb 11, 2024
- SHA
- a902f8e6
Model card
From the Hugging Face model README
See the main model card: https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge
Experimental imatrix quantizations, at 16K context, using a cocktail of data taken from the exllamav2 repo, kalomaze's random token tests and some stories.
Consider them experimental! But they may be better than the equivalent non-matrix GGUFs. Or they may not!
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Feb 10, 2024
- Updated
- Feb 11, 2024