Downloads · 30 days
0
flan-t5-small-redhat-docs-v2
mtpti5iD/flan-t5-small-redhat-docs-v2
flan-t5-small-redhat-docs-v2 is a machine learning model from mtpti5iD. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Fine-tuned FLAN-T5-Small for question-answering on Red Hat documentation using LoRA and 4-bit quantization. Trained on redhat-docsdataset (55,741 rows). - Base Model: google/flan-t5-small - Fine-Tuning: LoRA (r=8, alp…
Access
Public
Updated Jun 17, 2025
Repo size
2.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.4 MB · 63%
At a glance
- Access
- Public
- Created
- Jun 17, 2025
- Updated
- Jun 17, 2025
- SHA
- 36615d1f
Model card
From the Hugging Face model README
FLAN-T5-Small Fine-Tuned on Red Hat Documentation
Overview
Fine-tuned FLAN-T5-Small for question-answering on Red Hat documentation using LoRA and 4-bit quantization. Trained on redhat-docs_dataset (55,741 rows).
Model Details
- Base Model:
google/flan-t5-small - Fine-Tuning: LoRA (r=8, alpha=32, target_modules=["q", "v"])
- Quantization: 4-bit (nf4)
Dataset
- Fields:
title,content,command,url - Artifacts:
data/redhat-docs_dataset.jsonl,data/formatted_dataset.jsonl,data/tokenized_dataset.jsonl
Training
- Hardware: T4 GPU, CUDA 11.8
- Epochs: 2
- Batch Size: 32 (4 per-device, 8 gradient accumulation)
Usage
Load with peft and transformers for Red Hat queries.
License
MIT License. Verify dataset licensing.
Contact
See GitHub.
- Created
- Jun 17, 2025
- Updated
- Jun 17, 2025