Downloads · 30 days
20
0% of all-time downloads
LSX-UniWue/LLaMmlein_120M_prerelease
LLaMmlein_120M_prerelease is a text generation model from LSX-UniWue. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is a German Tinyllama 120M language model trained from scratch using the Tinyllama codebase on the German portion of RedPajama V2. Find more details on our page and our preprint
Downloads · 30 days
20
0% of all-time downloads
All-time downloads
6.1K
Public
Parameters
125M
37.9 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors499 MB · 100%
From the Hugging Face model README
This is a German Tinyllama 120M language model trained from scratch using the Tinyllama codebase on the German portion of RedPajama V2. Find more details on our page and our preprint
Next to the final model, we publish intermediate training checkpoints for our base models as separate branches of the model repository. These can be accessed via the drop-down menu labeled "main" in the top left corner of the "Files and versions" section.
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("LSX-UniWue/LLaMmlein_120M")
tokenizer = AutoTokenizer.from_pretrained("LSX-UniWue/LLaMmlein_120M")
We evaluated our model on the SuperGLEBer benchmark. Data Take Down