Downloads · 30 days
1
1% of all-time downloads
Roshang09112007/adaption-air-bench-healthcare-es
adaption-air-bench-healthcare-es is a text generation model from Roshang09112007. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.3.
This repository contains a LoRA adapter fine-tuned on the AIR-Bench Healthcare Spanish (ES) benchmark using Meta Llama 3.3 70B Instruct as the base model. The adapter is intended for research on healthcare-oriented in…
Downloads · 30 days
1
1% of all-time downloads
All-time downloads
71
Public
Repo size
3.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.3 GB · 99%
From the Hugging Face model README
This repository contains a LoRA adapter fine-tuned on the AIR-Bench Healthcare Spanish (ES) benchmark using Meta Llama 3.3 70B Instruct as the base model. The adapter is intended for research on healthcare-oriented instruction following, medical question answering, and clinical reasoning tasks in Spanish.
meta-llama/Llama-3.3-70B-InstructThis model is intended for:
Potential downstream applications include:
This model is not intended for:
This model inherits limitations from both:
Potential risks include:
Outputs should always be verified by qualified healthcare professionals.
Users should:
Install dependencies:
pip install transformers peft accelerate torch
Load the adapter:
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
import torch
BASE_MODEL = "meta-llama/Llama-3.3-70B-Instruct"
ADAPTER = "Roshang09112007/adaption-air-bench-healthcare-es"
tokenizer = AutoTokenizer.from_pretrained(BASE_MODEL)
base_model = AutoModelForCausalLM.from_pretrained(
BASE_MODEL,
torch_dtype=torch.bfloat16,
device_map="auto"
)
model = PeftModel.from_pretrained(
base_model,
ADAPTER
)
prompt = "¿Cuáles son los síntomas de la diabetes tipo 2?"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(
**inputs,
max_new_tokens=200
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
The model was fine-tuned using the AIR-Bench Healthcare Spanish (ES) dataset consisting of healthcare-related instruction-response pairs.
The model was trained using Parameter-Efficient Fine-Tuning (PEFT) with the LoRA method.
Evaluation was performed using healthcare-related Spanish benchmark examples.
Evaluation considered:
Potential evaluation metrics include:
Evaluation results are currently under investigation and may vary depending on task and prompting strategy.
This repository provides a LoRA adapter specialized for healthcare-related Spanish instruction-following tasks using Meta Llama 3.3 70B Instruct as the backbone model.
Carbon emissions were not formally measured.
Fine-tuning performed using GPU-based hardware acceleration.
@misc{roshan2026airbenchhealthcare,
title={AIR-Bench Healthcare ES LoRA Adapter},
author={Roshan G},
year={2026},
publisher={Hugging Face},
howpublished={\url{https://huggingface.co/Roshang09112007/adaption-air-bench-healthcare-es}}
}
Roshan G. (2026). AIR-Bench Healthcare ES LoRA Adapter. Hugging Face.
This model is released for research and educational purposes only.
Roshan G
Hugging Face: https://huggingface.co/Roshang09112007