Downloads · 30 days
5
25% of all-time downloads
ray-train-zero-3-bloom-1B
ash001/ray-train-zero-3-bloom-1B
ray-train-zero-3-bloom-1B is a machine learning model from ash001. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a fine-tuned version of bigscience/bloomz-1b1, fine-tuned using Ray Train with DeepSpeed ZeRO-3 for scalable distributed training with minimal configuration overhead.
All-time downloads
20
Public
Parameters
1.1B
14.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt12.8 GB · 75%
At a glance
- License
- apache-2.0
- Model type
- bloom
- Access
- Public
- Created
- Jun 21, 2025
- Updated
- Aug 5, 2025
- SHA
- 705b94e3
Model card
From the Hugging Face model README
BLOOMZ-1B1 Fine-tuned with Ray Train + DeepSpeed ZeRO-3
This model is a fine-tuned version of bigscience/bloomz-1b1, fine-tuned using Ray Train with DeepSpeed ZeRO-3 for scalable distributed training with minimal configuration overhead.
This model was fine-tuned using the IMDB dataset on 2 × T4 16GB GPUs, achieving 11% training loss reduction (from ~3.6 to ~3.2) with automated distributed orchestration.
For detailed implementation, Ray configurations, and distributed training setup, please check out the project repository.
- Type
- bloom
- License
- apache-2.0
- Created
- Jun 21, 2025
- Updated
- Aug 5, 2025