Downloads · 30 days
15
23% of all-time downloads
ash001/llm-foundry-fsdp-opt-1.3B-epoch-1
llm-foundry-fsdp-opt-1.3B-epoch-1 is a machine learning model from ash001. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This model is a fine-tuned version of facebook/opt-1.3b, fine-tuned using MosaicML's LLM Foundry framework with PyTorch FSDP for production-ready distributed training with config-based setup.
Downloads · 30 days
15
23% of all-time downloads
All-time downloads
66
Public
Parameters
1.3B
5.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.6 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of facebook/opt-1.3b, fine-tuned using MosaicML's LLM Foundry framework with PyTorch FSDP for production-ready distributed training with config-based setup.
This model was fine-tuned using the Dolly-15K instruction dataset on 2 × T4 16GB GPUs with built-in evaluation and experiment tracking.
For detailed implementation, configuration files, and training procedures, please check out the project repository.