Downloads · 30 days
10
3% of all-time downloads
ao9000/phi2-dropout
phi2-dropout is a text generation model from ao9000. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
- Dataset: Wikipedia-10 - Target modules = ["qproj", "kproj", "vproj", "dense", "fc1", "fc2"]
Downloads · 30 days
10
3% of all-time downloads
All-time downloads
377
Public
Parameters
2.8B
5.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.6 GB · 100%
From the Hugging Face model README
{
"epoch": 0.22326645805206993,
"total_flos": 1.04520375926784e+18,
"train_loss": 2.3526821104288103,
"train_runtime": 66080.1443,
"train_samples": 286653,
"train_samples_per_second": 0.969,
"train_steps_per_second": 0.03
}