Downloads · 30 days
12
3% of all-time downloads
distilbert-mlops-demo-ci
JeyaPrakashI/distilbert-mlops-demo-ci
distilbert-mlops-demo-ci is a machine learning model from JeyaPrakashI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as mit.
[](https://github.com/JeyaPrakashI/end-to-end-mlops-pipeline-aws/actions) [](https://huggingface.co/JeyaPrakashI/distilbert-mlops-demo-ci)
All-time downloads
437
Public
Repo size
74.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt17.8 MB · 63%
At a glance
- Library
- peft
- License
- mit
- Access
- Public
- Created
- Jan 10, 2026
- Updated
- Feb 7, 2026
- SHA
- f1a171cf
Base models
Datasets
Model card
From the Hugging Face model README
Model Card: DistilBERT MLOps Demo (CI/CD Pipeline)
Training Details
Training Procedure
- Experimental Phase: Rapid iteration on Google Colab (T4 GPU).
- Production Phase: Automated training via GitHub Actions runners.
Hyperparameters
- Method: PEFT (LoRA)
- Precision: FP16 Mixed Precision
- Optimizer: AdamW
Evaluation
Results Table
| Run Type | Epochs | Train Samples | Eval Samples | Accuracy | Runtime |
|---|---|---|---|---|---|
| Colab GPU (manual) | 3 | ~5,000 | ~1,000 | 85.3% | ~30 mins |
| GitHub Actions (CI/CD) | 2 | Full Pipeline | ~1,000 | 86.0% | ~5 hours |
Summary:
The automated CI/CD run achieved 86.0% accuracy, proving the pipeline can autonomously produce production-ready models with reproducibility.
Limitations & Risks
- Inherits biases from DistilBERT’s pretraining corpus (Wikipedia + Toronto Book Corpus).
- Restricted to English text.
- Not suitable for sensitive domains (medical, legal, financial) without domain-specific fine-tuning.
Environmental Impact
By using LoRA instead of full fine-tuning, compute requirements were reduced by ~90%, lowering both carbon footprint and operational costs.
Contact: Jeya Prakash I.
Project Goal: Bridging the gap between ML Research and Cloud Production.
- Library
- peft
- License
- mit
- Created
- Jan 10, 2026
- Updated
- Feb 7, 2026