Downloads · 30 days
33
7% of all-time downloads
FPll/Llama-LIMBA-2.0-GGUF
Llama-LIMBA-2.0-GGUF is a text generation model from FPll. Use it when you need the model to write or continue text. The card lists the license as llama3.1.
Downloads · 30 days
33
7% of all-time downloads
All-time downloads
494
Public
Repo size
4.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
Built with Llama
Llama LIMBA 2.0 is a fine-tuned Meta Llama 3.1 8B model developed for Italian and Limba Sarda Comuna (LSC).
The project explores the adaptation of a Large Language Model to a minority and low-resource language through parameter-efficient fine-tuning.
Llama LIMBA 2.0 supports:
| Component | Value |
|---|---|
| Base model | Meta Llama 3.1 8B |
| Training checkpoint | unsloth/Meta-Llama-3.1-8B-bnb-4bit |
| Fine-tuning framework | Unsloth |
| Fine-tuning method | LoRA |
| Quantized loading | 4-bit |
| Context length | 4096 tokens |
| LoRA rank | 32 |
| LoRA alpha | 64 |
| Training epochs | 3 |
| Export format | GGUF |
| Quantization | Q4_K_M |
| Primary language | Limba Sarda Comuna |
| Secondary language | Italian |
Meta-Llama-3.1-8B.Q4_K_M.gguf
The GGUF file can be used with compatible runtimes such as llama.cpp and llama-cpp-python.
LIMBA 2.0 can be tested through its Hugging Face Spaces interface:
https://huggingface.co/spaces/FPll/Limba_2.0
The demo includes a Gradio conversational interface and lightweight retrieval from Sardinian and Italian Wikipedia.
The complete project repository includes:
https://github.com/francesco-palladino/LIMBA-Sardinian-Language-Model
Llama LIMBA 2.0 is intended for:
The model may:
The current evaluation process is primarily qualitative and does not yet constitute a formal linguistic benchmark.
Human review is recommended for translations, educational materials, public communications and content requiring linguistic or factual accuracy.
Llama LIMBA 2.0 should not be treated as the sole source for:
Generated and retrieval-assisted information should be independently verified.
This model is distributed under the Meta Llama 3.1 Community License.
Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.
Fine-tuning and GGUF conversion were performed using Unsloth.