EQASpa-7b

nsuruguay05/EQASpa-7b

EQASpa-7b is a text generation model from nsuruguay05. Use it when you need the model to write or continue text. It is set up for transformers.

This model is a fine-tuned version of Llama-2-7b-hf for the Extractive Question Answering task in spanish.

Downloads · 30 days

29% of all-time downloads

All-time downloads

Public

Parameters

6.7B

13.5 GB on disk

Likes

Public

Repo makeup

Click a slice to open those files.

.safetensors13.5 GB · 100%

From the Hugging Face model README

This model is a fine-tuned version of Llama-2-7b-hf for the Extractive Question Answering task in spanish.

It was fine-tuned on the QuALES 2022 dataset training partition using LoRA for one epoch.

To use the model, the following prompting format should be applied:

### TEXTO:
{{Context document}}
### PREGUNTA:
{{Question}}
### RESPUESTA:

We evaluate the model on the test partition of the QuALES dataset, and compare it with one-shot prompting as a baseline.

Prompt	Model	Acc_exact	F_bertscore
one-shot prompting	zephyr-7b-beta	0.025	0.614
one-shot prompting	Llama-2-13b-chat-hf	0.192	0.700
default	EQASpa 7b	0.225	0.713

The following bitsandbytes quantization config was used during training: