Downloads · 30 days
73
1% of all-time downloads
Yi-1.5-9B-Chat-GGUF
thesven/Yi-1.5-9B-Chat-GGUF
Yi-1.5-9B-Chat-GGUF is a machine learning model from thesven. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
6K
Public
Repo size
117 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf128 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- May 24, 2024
- Updated
- May 24, 2024
- SHA
- 4ac00526
Model card
From the Hugging Face model README
<div align="center">
<picture>
<img src="https://raw.githubusercontent.com/01-ai/Yi/main/assets/img/Yi_logo_icon_light.svg" width="150px">
</picture>
</div>
<p align="center">
<a href="https://github.com/01-ai">🐙 GitHub</a> •
<a href="https://discord.gg/hYUwWddeAu">👾 Discord</a> •
<a href="https://twitter.com/01ai_yi">🐤 Twitter</a> •
<a href="https://github.com/01-ai/Yi-1.5/issues/2">💬 WeChat</a>
<br/>
<a href="https://arxiv.org/abs/2403.04652">📝 Paper</a> •
<a href="https://01-ai.github.io/">💪 Tech Blog</a> •
<a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#faq">🙌 FAQ</a> •
<a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#learning-hub">📗 Learning Hub</a>
</p>
</div>
Quantization Description
<div style="text-align: center;"> <a href="https://github.com/thesven/GGUF-n-Go"> <img src="https://github.com/thesven/GGUF-n-Go/blob/main/assets/quantized_with.png?raw=true" alt="image/png" style="max-width: 350px;"> </a> </div>This repo contains GGUF quantized versions of the Yi 1.5 9B Chat model. The model is supplied in different quantizations so that you can see what works best on the hardware you would like to run it on.
The repo contains quantizations in the following types:
- Q4_0
- Q4_1
- Q4_K
- Q4_K_S
- Q4_K_M
- Q5_0
- Q5_1
- Q5_K
- Q5_K_M
- Q5_K_S
- Q6_K
- Q8_0
- Q2_K
- Q3_K
- Q3_K_S
- Q3_K_XS
- IQ2_K
- IQ3_S
- IQ3_XXS
- IQ4_NL
- IQ4_XS
- IQ5_K
- IQ2_S
- IQ2_XS
- IQ1_S
Intro
Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples.
Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.
<div align="center">| Model | Context Length | Pre-trained Tokens |
|---|---|---|
| Yi-1.5 | 4K, 16K, 32K | 3.6T |
Models
-
Chat models
<div align="center"></div>Name Download Yi-1.5-34B-Chat • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-34B-Chat-16K • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-9B-Chat • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-9B-Chat-16K • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-6B-Chat • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel -
Base models
<div align="center"></div>Name Download Yi-1.5-34B • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-34B-32K • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-9B • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-9B-32K • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel Yi-1.5-6B • 🤗 Hugging Face • 🤖 ModelScope • 🔍 wisemodel
Benchmarks
-
Chat models
Yi-1.5-34B-Chat is on par with or excels beyond larger models in most benchmarks.
Yi-1.5-9B-Chat is the top performer among similarly sized open-source models.
-
Base models
Yi-1.5-34B is on par with or excels beyond larger models in some benchmarks.
Yi-1.5-9B is the top performer among similarly sized open-source models.
Quick Start
For getting up and running with Yi-1.5 models quickly, see README.
- License
- apache-2.0
- Created
- May 24, 2024
- Updated
- May 24, 2024