llama3-8b-quaero-lora

LLaMA 3 8B fine-tuned on Quaero for Named Entity Recognition (Generative)

This is a LoRA adapter version of unsloth/Meta-Llama-3.1-8B-Instruct, fine-tuned on the Quaero French medical dataset using a generative approach to Named Entity Recognition (NER).

Task

The model was trained to extract entities from French biomedical sentences (medlines) using a structured, prompt-based format.

I use <> as a separator and the output format is :

TAG_1 entity_1 <> TAG_2 entity_2 <> ... <> TAG_n entity_n

Dataset

The original dataset is Quaero French Medical Corpus and I converted it to a JSON format for generative instruction-style training.

{
  "input": "Etude de l'efficacité et de la tolérance de la prazosine à libération prolongée chez des patients hypertendus et diabétiques non insulinodépendants.",
  "output": "DISO tolérance <> CHEM prazosine <> LIVB patients <> DISO hypertendus <> DISO diabétiques non insulinodépendants"
}

The QUAERO French Medical corpus features overlapping entity spans, including nested structures, for instance :

{
  "input": "Cancer du pancréas",
  "output": "DISO Cancer <> DISO Cancer du pancréas <> ANAT pancréas"
}

Evaluation

Evaluation was performed on the test split by comparing the predicted entity set against the ground truth annotations using exact (type, entity) matching.

Other formats

This model is also available in the following formats:

• 16-bit
  → yqnis/llama3-8b-quaero

• GGUF Q8_0
  → yqnis/llama3-8b-quaero-gguf

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.