Downloads · 30 days
19
23% of all-time downloads
llammas-prelim
tartuNLP/llammas-prelim
llammas-prelim is a text generation model from tartuNLP. Use it when you need the model to write or continue text. It is set up for transformers.
Llama-2-7B finetuned in three stages: 1. 1B tokens of CulturaX (75% Estonain, 25% English) 2. 1M English-Estonian sentence-pairs from CCMatrix (500000), WikiMatrix (400000), Europarl (50000), and OpenSubtitles (50000)…
All-time downloads
83
Public
Parameters
6.7B
53.9 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Nov 3, 2023
- Updated
- Nov 14, 2023
- SHA
- 418d0dc0
Try a prompt
Model card
From the Hugging Face model README
Llama-2-7B finetuned in three stages:
- 1B tokens of CulturaX (75% Estonain, 25% English)
- 1M English->Estonian sentence-pairs from CCMatrix (500000), WikiMatrix (400000), Europarl (50000), and OpenSubtitles (50000) as Alpaca-style translation instructions
- Alpaca-cleaned and Alpaca-est (both ~50000 instructions)
Alpaca-est is an instruction dataset generated for Estonian with gpt-3.5-turbo-0613, following Alpaca.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- et
- Created
- Nov 3, 2023
- Updated
- Nov 14, 2023