Downloads · 30 days
10
11% of all-time downloads
gonggongjohn/llama3.2-1b-zh-pt-culturax-10b
llama3.2-1b-zh-pt-culturax-10b is a text generation model from gonggongjohn. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
10
11% of all-time downloads
All-time downloads
89
Public
Parameters
1.2B
5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.9 GB · 100%
From the Hugging Face model README
Training loss performance:
<img src="llama3.2_1b_pretrain_zh_10b_loss.png">| Model | Belebele | MGSM Direct | Global MMLU | XCopa | XNLI | XStoryCloze |
|---|---|---|---|---|---|---|
| LLaMA3.2-1B-RandomInit | 0.2667 | 0.0040 | 0.2504 | 0.4700 | 0.3361 | 0.4672 |
| LLaMA3.2-1B-zh-pt-CulturaX-10B | 0.2311 | 0.0160 | 0.2285 | 0.5200 | 0.3361 | 0.4851 |