Downloads · 30 days
153
7% of all-time downloads
RichardErkhov/KnutJaegersberg_-_Yi-34B-200K-MiniOrca-gguf
KnutJaegersberg_-_Yi-34B-200K-MiniOrca-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
153
7% of all-time downloads
All-time downloads
2.3K
Public
Repo size
369 GB
Likes
0
Public
Click a slice to open those files.
.gguf430 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Yi-34B-200K-MiniOrca - GGUF
| Name | Quant method | Size |
|---|---|---|
| Yi-34B-200K-MiniOrca.Q2_K.gguf | Q2_K | 11.94GB |
| Yi-34B-200K-MiniOrca.IQ3_XS.gguf | IQ3_XS | 13.26GB |
| Yi-34B-200K-MiniOrca.IQ3_S.gguf | IQ3_S | 13.99GB |
| Yi-34B-200K-MiniOrca.Q3_K_S.gguf | Q3_K_S | 13.93GB |
| Yi-34B-200K-MiniOrca.IQ3_M.gguf | IQ3_M | 5.07GB |
| Yi-34B-200K-MiniOrca.Q3_K.gguf | Q3_K | 15.51GB |
| Yi-34B-200K-MiniOrca.Q3_K_M.gguf | Q3_K_M | 15.51GB |
| Yi-34B-200K-MiniOrca.Q3_K_L.gguf | Q3_K_L | 13.53GB |
| Yi-34B-200K-MiniOrca.IQ4_XS.gguf | IQ4_XS | 14.63GB |
| Yi-34B-200K-MiniOrca.Q4_0.gguf | Q4_0 | 18.13GB |
| Yi-34B-200K-MiniOrca.IQ4_NL.gguf | IQ4_NL | 18.3GB |
| Yi-34B-200K-MiniOrca.Q4_K_S.gguf | Q4_K_S | 18.25GB |
| Yi-34B-200K-MiniOrca.Q4_K.gguf | Q4_K | 19.24GB |
| Yi-34B-200K-MiniOrca.Q4_K_M.gguf | Q4_K_M | 19.24GB |
| Yi-34B-200K-MiniOrca.Q4_1.gguf | Q4_1 | 20.1GB |
| Yi-34B-200K-MiniOrca.Q5_0.gguf | Q5_0 | 22.08GB |
| Yi-34B-200K-MiniOrca.Q5_K_S.gguf | Q5_K_S | 18.34GB |
| Yi-34B-200K-MiniOrca.Q5_K.gguf | Q5_K | 22.65GB |
| Yi-34B-200K-MiniOrca.Q5_K_M.gguf | Q5_K_M | 22.65GB |
| Yi-34B-200K-MiniOrca.Q5_1.gguf | Q5_1 | 24.05GB |
| Yi-34B-200K-MiniOrca.Q6_K.gguf | Q6_K | 26.28GB |
| Yi-34B-200K-MiniOrca.Q8_0.gguf | Q8_0 | 34.03GB |
Original model description:
license: other license_name: yi-license license_link: LICENSE pipeline_tag: text-generation datasets:
Trained for 2.7 epochs on the 50k shortest records of miniorca dataset with NEFTune. The base model is the official yi-34b-200k model.
Prompt Example:
### System:
You are an AI assistant. You will be given a task. You must generate a detailed and long answer.
### User:
What is AGI?
### Assistant:
License The source code in this repo is licensed under the Apache 2.0 license. The Yi series models are fully open for academic research and free commercial usage with permission via applications. All usage must adhere to the Model License Agreement 2.0. To apply for the official commercial license, please contact us ([email protected]).