Downloads · 30 days
0
Databricks-Dolly15k-Mistral-Finetuning
Alpha7a/Databricks-Dolly15k-Mistral-Finetuning
Databricks-Dolly15k-Mistral-Finetuning is a machine learning model from Alpha7a. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a fine-tuned version of Mistral-7B-Instruct trained using a subset of the Databricks Dolly 15k instruction dataset. Training was performed with LoRA using the trl library’s SFTTrainer.
Access
Public
Updated Nov 29, 2025
Repo size
55.1 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors54.6 MB · 93%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Nov 29, 2025
- Updated
- Nov 29, 2025
- SHA
- ebb0c4fa
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
🦙 Mistral-7B Instruct – Fine-Tuned on Databricks Dolly 15k
This model is a fine-tuned version of Mistral-7B-Instruct trained using a subset of the Databricks Dolly 15k instruction dataset.
Training was performed with LoRA using the trl library’s SFTTrainer.
🚀 Model Purpose
The goal of this fine-tuning run is to:
- Improve instruction-following abilities
- Enhance short-form question-answering
- Produce more concise and helpful outputs
- Evaluate ROUGE improvements on Dolly-style tasks
This model is not intended to exceed top-tier instruct models but to provide a lightweight, reproducible fine-tune for research and experimentation.
🧠 Base Model
Mistral-7B-Instruct
- 7B parameters
- Optimized for instruction following
- Strong general capabilities
- License: Apache 2.0
📚 Training Dataset
Dataset: databricks/databricks-dolly-15k
Split: 95% train / 5% test
Seed: 4016
Dolly is a small, mixed-quality instruction dataset containing multiple task types:
- open-QA
- summarization
- classification
- brainstorming
- hypothetical reasoning
🏋️ Training Details
Hyperparameters
- License
- apache-2.0
- Created
- Nov 29, 2025
- Updated
- Nov 29, 2025