Downloads · 30 days
4
3% of all-time downloads
thedanmaks/Llama-3.1-8B-UA-GEC
Llama-3.1-8B-UA-GEC is a text generation model from thedanmaks. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: Daniil Maksymenko - License: apache-2.0 - Finetuned from model : unsloth/llama-3.1-8b-instruct-unsloth-bnb-4bit - The model is still in development and needs more data and train runs. So be cautious wi…
Downloads · 30 days
4
3% of all-time downloads
All-time downloads
157
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Llama 3.1 8B trained on UA GEC Fluency dataset to fix grammar, style and spelling mistakes in the text. Training was done with GRPO, no SFT/DPO.
TODO: train on short texts and single words / word combinations to avoid hallucinations caused by short inputs. Also, gather more data overall.