AMALIA-ExtraiConheCiencia-PT

AMALIA-ExtraiConheCiencia-PT

Model Description

AMALIA-ExtraiConheCiencia-PT is a fine-tuned version of the AMALIA 9B European Portuguese large language model, adapted for Scientific Information Extraction (SciIE) in Portuguese.

The model was fine-tuned on SCIERC-PT, a European Portuguese translation and curation of the SCIERC dataset. It is designed to perform joint extraction of scientific entities and relations from articles abstracts, producing structured outputs suitable for Named Entity Recognition (NER), Relation Extraction (RE), and downstream Scientific Knowledge Graph construction.

Base Model

• Base model: AMALIA-9B-1225-SFT
• Language: European Portuguese (PT-PT)
• Architecture: Decoder-only generative LLM
• Fine-tuning method: QLoRA
• Fine-tuning Task: Joint Scientific Information Extraction

Intended Use

This model is intended for:

• Scientific Information Extraction in Portuguese:
  • Named Entity Recognition from scientific abstracts
  • Relation Extraction from scientific abstracts
• Structured extraction for Scientific Knowledge Graph construction

Input Format

The model expects a European Portuguese scientific abstract and task instructions specifying the entity and relation schema.

Example input:

Extrai entidades e relações do texto científico usando o esquema fornecido.

Tipos de entidade: Tarefa, Método, Métrica, Material, Outros Termos Científicos, Genérico.
Tipos de relação: Usado-para, Característica-de, Hipónimo-de, Parte-de, Avaliado-para, Comparado-com, Conjunção.

Texto:
{text}

Output Format

The model was fine-tuned to generate structured outputs containing scientific entities, entity types, and relations.

The expected output corresponds to structured triples.

Example output:

[
  {
    "sujeito": "<subject entity text>",
    "tipo_sujeito": "<subject entity type>",
    "relação": "<relation type>",
    "objeto": "<object entity text>",
    "tipo_objeto": "<object entity type>"
  }
  ...
]

Training Data

The model was fine-tuned on SCIERC-PT, a European Portuguese version of SCIERC.

SCIERC-PT contains computer science abstracts annotated with scientific entities and semantic relations.

Entity Types

Relation Types

Training Procedure

The model was adapted using QLoRA for parameter-efficient supervised fine-tuning. Fine-tuning was performed using the joint extraction formulation, where the model receives a Portuguese scientific abstract and generates structured triples containing entities, entity types, and relations.

Training Configuration

The model was trained using the training split of SCIERC-PT and validated on the development split. The best checkpoint was selected according to validation loss.

Evaluation

The model was evaluated on the SCIERC-PT test split using F1-score under a strict exact-match evaluation protocol.

In the fine-tuned setting, AMALIA-ExtraiConheCiencia-PT achieved:

More Information

For more information about the model, the fine-tuning dataset and process, and its use in Portuguese Scientific Information Extraction experiments, see our paper:

• Paper: Evaluating Generative Large Language Models for Portuguese Scientific Information Extraction (NSLP 2026)
• https://lrec.elra.info/lrec2026-ws-nslp-15