Downloads · 30 days
6
32% of all-time downloads
01-ai_-_Yi-1.5-9B-4bits
RichardErkhov/01-ai_-_Yi-1.5-9B-4bits
01-ai_-_Yi-1.5-9B-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
19
Public
Parameters
9B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
U88.3B · 93%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Yi-1.5-9B - bnb 4bits
- Model creator: https://huggingface.co/01-ai/
- Original model: https://huggingface.co/01-ai/Yi-1.5-9B/
Original model description:
license: apache-2.0
<div align="center"> <picture> <img src="https://raw.githubusercontent.com/01-ai/Yi/main/assets/img/Yi_logo_icon_light.svg" width="150px"> </picture> </div> <p align="center"> <a href="https://github.com/01-ai">🐙 GitHub</a> • <a href="https://discord.gg/hYUwWddeAu">👾 Discord</a> • <a href="https://twitter.com/01ai_yi">🐤 Twitter</a> • <a href="https://github.com/01-ai/Yi-1.5/issues/2">💬 WeChat</a> <br/> <a href="https://arxiv.org/abs/2403.04652">📝 Paper</a> • <a href="https://01-ai.github.io/">💪 Tech Blog</a> • <a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#faq">🙌 FAQ</a> • <a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#learning-hub">📗 Learning Hub</a> </p>Intro
Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples.
Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.
<div align="center">| Model | Context Length | Pre-trained Tokens |
|---|---|---|
| Yi-1.5 | 4K, 16K, 32K | 3.6T |
Models
-
Chat models
<div align="center"></div>Name Download Yi-1.5-34B-Chat • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-34B-Chat-16K • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-9B-Chat • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-9B-Chat-16K • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-6B-Chat • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel -
Base models
<div align="center"></div>Name Download Yi-1.5-34B • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-34B-32K • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-9B • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-9B-32K • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel Yi-1.5-6B • 🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel
Benchmarks
-
Chat models
Yi-1.5-34B-Chat is on par with or excels beyond larger models in most benchmarks.
Yi-1.5-9B-Chat is the top performer among similarly sized open-source models.
-
Base models
Yi-1.5-34B is on par with or excels beyond larger models in some benchmarks.
Yi-1.5-9B is the top performer among similarly sized open-source models.
Quick Start
For getting up and running with Yi-1.5 models quickly, see README.
- Type
- llama
- Created
- Oct 6, 2024
- Updated
- Oct 6, 2024