Downloads · 30 days
3
8% of all-time downloads
RichardErkhov/Minbyul_-_meditron-7b-wo-kqa_golden-iter-sft-step1-8bits
Minbyul_-_meditron-7b-wo-kqa_golden-iter-sft-step1-8bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
3
8% of all-time downloads
All-time downloads
37
Public
Parameters
6.7B
7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7 GB · 100%
How the weights are stored.
I86.5B · 96%
From the Hugging Face model README
Quantization made by Richard Erkhov.
meditron-7b-wo-kqa_golden-iter-sft-step1 - bnb 8bits
license: llama2 base_model: epfl-llm/meditron-7b tags:
This model is a fine-tuned version of epfl-llm/meditron-7b on the HuggingFaceH4/deita-10k-v0-sft dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 2.2849 | 0.99 | 19 | 1.2240 |
| 1.9826 | 1.97 | 38 | 1.2528 |
| 1.7301 | 2.96 | 57 | 1.3041 |