MaternaCare-ES-gemma4-qlora

MaternaCare-ES Gemma 4 QLoRA

<p align="center"> <img src="app-icon.png" alt="MaternaQA-es / MaternaCare-ES visual identity" width="180" /> </p>

MaternaCare-ES Gemma 4 QLoRA is a PEFT/QLoRA adapter for google/gemma-4-E2B-it, fine-tuned for Spanish maternal-health question answering with grounded clinical context.

The adapter was trained on the grounded SFT split of iue-edu/MaternaQA-es, a Spanish obstetrics and maternal-health QA dataset built from curated clinical PDF sources.

This is a research artifact. It is not a medical device and must not be used as a substitute for professional clinical judgment.

Highlights

• Language: Spanish
• Domain: obstetrics, pregnancy, labor, postpartum care, fetal monitoring, and maternal health
• Training style: grounded supervised fine-tuning
• Adapter type: QLoRA / LoRA for causal language modeling
• Dataset: iue-edu/MaternaQA-es
• Code repository: JhonHander/MaternaCare-ES

Intended use

This adapter is intended for research and development workflows such as:

• Spanish medical QA experiments in maternal-health contexts.
• Comparing grounded vs. base-model generation.
• Evaluating domain adaptation with lightweight QLoRA adapters.
• Building reproducible academic baselines for obstetrics-focused NLP.

It is not intended for direct patient care, autonomous diagnosis, treatment recommendation, emergency triage, or any clinical decision-making workflow.

Training data

The model was fine-tuned with the sft_grounded configuration of MaternaQA-es.

In the grounded format, each example provides source context and a question, and the assistant is trained to answer using that context.

Training procedure

The adapter was trained with TRL supervised fine-tuning and PEFT QLoRA.

Observed training setup from the public repository:

Evaluation

Evaluation was run on the MaternaQA-es test split with 328 predictions. Automatic metrics are useful for comparison, but they do not establish clinical correctness.

Evaluation setup:

• Test examples: 328
• Judge model: gpt-5.4-mini
• Embedding model: text-embedding-3-small
• Evaluation errors: 1

Usage

The underlying Gemma base model is gated. Before loading this adapter, make sure you have accepted the base-model terms on Hugging Face and are authenticated locally.

from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer
import torch

adapter_id = "iue-edu/MaternaCare-ES-gemma4-qlora"

tokenizer = AutoTokenizer.from_pretrained(adapter_id)
model = AutoPeftModelForCausalLM.from_pretrained(
    adapter_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

context = """Contexto fuente: [Insert reviewed clinical context here.]"""
question = "¿Cuáles son los signos de alarma durante el embarazo?"

messages = [
    {
        "role": "user",
        "content": f"{context}\n\nPregunta: {question}\n\nResponde en español usando el contexto fuente.",
    }
]

inputs = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_tensors="pt",
).to(model.device)

with torch.no_grad():
    output = model.generate(
        inputs,
        max_new_tokens=256,
        temperature=0.2,
        do_sample=False,
        repetition_penalty=1.05,
    )

print(tokenizer.decode(output[0][inputs.shape[-1]:], skip_special_tokens=True))

Responsible use

This adapter may generate fluent but incorrect or incomplete medical text. Use it only in controlled research settings with expert review.

Do not use it for:

• Diagnosis or treatment decisions.
• Patient-facing medical advice without clinical supervision.
• Emergency, triage, or high-risk care workflows.
• Replacing official medical guidelines or professional judgment.

Limitations

• Fine-tuning data is synthetic and Spanish-language.
• Grounded generation quality depends on the quality and relevance of the provided context.
• Evaluation metrics are automatic and may miss clinically important errors.
• The adapter inherits limitations and access constraints from the gated Gemma base model.

Citation

If you use this adapter, please cite the dataset and the training/evaluation repository:

@misc{maternaqa_es,
  title        = {MaternaQA-es: A Spanish Maternal-Health Question Answering Dataset},
  author       = {Instituci\'on Universitaria de Envigado and collaborators},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/datasets/iue-edu/MaternaQA-es}}
}

@misc{maternacare_es,
  title        = {MaternaCare-ES: Spanish Maternal-Health QLoRA Adapters},
  author       = {Instituci\'on Universitaria de Envigado and collaborators},
  year         = {2026},
  howpublished = {\url{https://github.com/JhonHander/MaternaCare-ES}}
}