Downloads · 30 days
81
11% of all-time downloads
HuYaLM-100B-fp16
BlackSamorez/HuYaLM-100B-fp16
HuYaLM-100B-fp16 is a machine learning model from BlackSamorez. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Hugging Face YaLM 100B (by BlackSamorez) is a transformers-compatible implementation of the YaLM 100B model. Originally trained by Yandex, the model used 800 A100 graphics cards and 1.7 TB of diverse text data, includ…
All-time downloads
765
Public
Repo size
202 GB
Likes
17
Public
Repo makeup
Click a slice to open those files.
.pt202 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- yalm
- Access
- Public
- Created
- Sep 5, 2023
- Updated
- Sep 5, 2023
- SHA
- 234c0fa3
Model card
From the Hugging Face model README
HuYaLM 100B
Hugging Face YaLM 100B (by BlackSamorez) is a transformers-compatible implementation of the YaLM 100B model. Originally trained by Yandex, the model used 800 A100 graphics cards and 1.7 TB of diverse text data, including online texts and books, in both English and Russian.
The motivation behind this particular implementation is to update the originally published, outdated code to align with the latest advancements in the field. As this code is compatible with the transformers library, it inherently supports crucial features like quantization (for model size optimization) and adapter training (for efficient fine-tuning).
For more details on training, acceleration, and stabilization techniques, you can refer to articles on Medium (in English) and Habr (in Russian). The original code from Yandex is available on GitHub.
This code and model are distributed under the Apache 2.0 license, which allows for commercial use.
- Library
- transformers
- Type
- yalm
- License
- apache-2.0
- Languages
- en, ru
- Created
- Sep 5, 2023
- Updated
- Sep 5, 2023