Downloads · 30 days
0
yalm-100b
yandex/yalm-100b
yalm-100b is a machine learning model from yandex. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Access
Public
Updated Jun 26, 2022
Repo size
202 GB
Likes
143
Public
Repo makeup
Click a slice to open those files.
.pt202 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 23, 2022
- Updated
- Jun 26, 2022
- SHA
- 73fbaafb
Model card
From the Hugging Face model README
YaLM 100B
https://github.com/yandex/YaLM-100B
YaLM 100B is a GPT-like neural network for generating and processing text. It can be used freely by developers and researchers from all over the world.
The model leverages 100 billion parameters. It took 65 days to train the model on a cluster of 800 A100 graphics cards and 1.7 TB of online texts, books, and countless other sources in both English and Russian.
Training details and best practices on acceleration and stabilizations can be found on Medium (English) and Habr (Russian) articles.
- License
- apache-2.0
- Languages
- en, ru
- Created
- Jun 23, 2022
- Updated
- Jun 26, 2022