Downloads · 30 days
10
20% of all-time downloads
Sagicc/Qwen3-0.6B-sr
Qwen3-0.6B-sr is a machine learning model from Sagicc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-sa-4.0.
This is an experiment wheither is possible to "learn" small model to think/speak Serbian combining two datasets, PhD theses and Serbian/English translated pairs.
Downloads · 30 days
10
20% of all-time downloads
All-time downloads
51
Public
Parameters
596M
1.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.2 GB · 99%
From the Hugging Face model README
This is an experiment wheither is possible to "learn" small model to think/speak Serbian combining two datasets, PhD theses and Serbian/English translated pairs.
Used full training on single GPU with 24G VRAM.
Limited on 100.000 paragraphs to fit with the size of a model.
TrainOutput(
global_step=6250,
training_loss=2.4078646276855467,
metrics={
'train_runtime': 6637.2579,
'train_samples_per_second': 15.066,
'train_steps_per_second': 0.942,
'total_flos': 1.685871939134423e+17,
'train_loss': 2.4078646276855467,
'entropy': 2.320802170932293,
'num_tokens': 44336234.0,
'mean_token_accuracy': 0.5260497442260385,
'epoch': 1.0
}
)
Used as base model for instruct-sr.