Downloads · 30 days
127
3% of all-time downloads
RichardErkhov/collaiborateorg_-_Collaiborator-MEDLLM-Llama-3-8B-v2-gguf
collaiborateorg_-_Collaiborator-MEDLLM-Llama-3-8B-v2-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
127
3% of all-time downloads
All-time downloads
4.6K
Public
Repo size
92.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf108 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Collaiborator-MEDLLM-Llama-3-8B-v2 - GGUF
license: llama3 library_name: transformers tags:
This model is a fine-tuned version of meta-llama/Meta-Llama-3-8B-Instruct on our custom "BioMedData" dataset.
Model Name: Collaiborator-MEDLLM-Llama-3-8b-v2
Base Model: Llama-3-8B-Instruct
Parameter Count: 8 billion
Training Data: Custom high-quality biomedical dataset
Number of Entries in Dataset: 500,000+
Dataset Composition: The dataset comprises both synthetic and manually curated samples, ensuring a diverse and comprehensive coverage of biomedical knowledge.
Collaiborator-MEDLLM-Llama-3-8b-v2 is a specialized large language model designed for biomedical applications. It is finetuned from the Llama-3-8B-Instruct model using a custom dataset containing over 500,000 diverse entries. These entries include a mix of synthetic and manually curated data, ensuring high quality and broad coverage of biomedical topics.
The model is trained to understand and generate text related to various biomedical fields, making it a valuable tool for researchers, clinicians, and other professionals in the biomedical domain.
Collaiborator-MEDLLM-Llama-3-8b-v2 outperforms many of the leading LLMs and find below its metrics evaluated using the Eleuther AI Language Model Evaluation Harness framework against the tasks medmcqa, medqa_4options, mmlu_anatomy, mmlu_clinical_knowledge, mmlu_college_biology, mmlu_college_medicine, mmlu_medical_genetics, mmlu_professional_medicine and pubmedqa


<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/653f5b93cd52f288490edc83/piGRPwvcBTLmcgExL89zp.mp4"></video>
Collaiborator-MEDLLM-Llama-3-8b-v2 is intended for a wide range of applications within the biomedical field, including:
While Collaiborator-MEDLLM-Llama-3-8b-v2 performs well in various biomedical NLP tasks, users should be aware of the following limitations:
Biases: The model may inherit biases present in the training data. Efforts have been made to curate a balanced dataset, but some biases may persist.
Accuracy: The model's responses are based on patterns in the data it has seen and may not always be accurate or up-to-date. Users should verify critical information from reliable sources.
Ethical Use: The model should be used responsibly, particularly in clinical settings where the stakes are high. It should complement, not replace, professional judgment and expertise.
Collaiborator-MEDLLM-Llama-3-8b-v2 was trained using NVIDIA A40 GPU's, which provides the computational power necessary for handling large-scale data and model parameters efficiently. Rigorous evaluation protocols have been implemented to benchmark its performance against similar models, ensuring its robustness and reliability in real-world applications.
import transformers import torch
model_id = "collaiborateorg/Collaiborator-MEDLLM-Llama-3-8B-v2"
pipeline = transformers.pipeline( "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto", )
messages = [ {"role": "system", "content": "You are an expert trained on healthcare and biomedical domain!"}, {"role": "user", "content": "I'm a 35-year-old male and for the past few months, I've been experiencing fatigue, increased sensitivity to cold, and dry, itchy skin. What is the diagnosis here?"}, ]
prompt = pipeline.tokenizer.apply_chat_template( messages, tokenize=False, add_generation_prompt=True )
terminators = [ pipeline.tokenizer.eos_token_id, pipeline.tokenizer.convert_tokens_to_ids("<|eot_id|>") ]
outputs = pipeline( prompt, max_new_tokens=256, eos_token_id=terminators, do_sample=True, temperature=0.6, top_p=0.9, )
print(outputs[0]["generated_text"][len(prompt):])
For further information, inquiries, or issues related to Biomed-LLM, please contact:
Email: [email protected]
Website: https://www.collaiborate.com
The following hyperparameters were used during training:
If you use Collaiborator-MEDLLM-Llama-3-8b in your research or applications, please cite it as follows:
@misc{Collaiborator_MEDLLM, author = Collaiborator, title = {Collaiborator-MEDLLM-Llama-3-8b: A High-Performance Biomedical Language Model}, year = {2024}, howpublished = {https://huggingface.co/collaiborateorg/Collaiborator-MEDLLM-Llama-3-8B-v2}, }