Downloads · 30 days
0
medllama-lora-13b
artem9k/medllama-lora-13b
medllama-lora-13b is a machine learning model from artem9k. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This model has not been evaluated yet, and should NOT be used for medical advice. It is an experiment to create a domain-specific model from LLaMA using LoRA finetuning.
Access
Public
Updated Mar 30, 2023
Repo size
—
Likes
2
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 71%
At a glance
- License
- other
- Access
- Public
- Created
- Mar 30, 2023
- Updated
- Mar 30, 2023
- SHA
- 2b5f4912
Model card
From the Hugging Face model README
MedLLAMA-LoRA
Experimental llama finetune on medical qa dataset
This model has not been evaluated yet, and should NOT be used for medical advice. It is an experiment to create a domain-specific model from LLaMA using LoRA finetuning.
Training Details:
- 13b model, finetuned on 76k question-answer pairs
- superset of alpaca-data-cleaned instruct dataset with additional medical qa pairs adapted from icliniq dataset
- Trained for 18 hours on A100, minibatch size 10, batch size 256, cutoff_len 512, all other parameters default
- https://github.com/tloen/alpaca-lora
- License
- other
- Created
- Mar 30, 2023
- Updated
- Mar 30, 2023