Downloads · 30 days
21
18% of all-time downloads
yqnis/llama3-8b-quaero-gguf
llama3-8b-quaero-gguf is a machine learning model from yqnis. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a Quantized version (Q5KM) of yqnis/llama3-8b-quaero, a model fine-tuned on the Quaero French medical dataset using a generative approach to Named Entity Recognition (NER).
Downloads · 30 days
21
18% of all-time downloads
All-time downloads
118
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.7 GB · 100%
From the Hugging Face model README
This is a Quantized version (Q5_K_M) of yqnis/llama3-8b-quaero, a model fine-tuned on the Quaero French medical dataset using a generative approach to Named Entity Recognition (NER).
This model is also available in the following formats:
16-bit
→ yqnis/llama3-8b-quaero
LoRA Q8_0
→ yqnis/llama3-8b-quaero-lora
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.