Downloads · 30 days
0
ash001/deepspeed-offload-llama-3.2-1B
deepspeed-offload-llama-3.2-1B is a machine learning model from ash001. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is a fine-tuned version of meta-llama/Llama-3.2-1B-Instruct, fine-tuned using DeepSpeed's ZeRO-2 Offload to enable efficient training of billion-parameter models on single GPU setups.
Downloads · 30 days
0
Access
Public
Updated Aug 5, 2025
Repo size
7.4 GB
Likes
0
Public
Click a slice to open those files.
.pt2.5 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of meta-llama/Llama-3.2-1B-Instruct, fine-tuned using DeepSpeed's ZeRO-2 Offload to enable efficient training of billion-parameter models on single GPU setups.
This model was fine-tuned using the arxiv-abstract-dataset on a single Tesla P100 16GB GPU with CPU memory offloading.
For detailed implementation, DeepSpeed configuration, and hardware requirements, please check out the project repository.