Downloads · 30 days
14
0% of all-time downloads
pszemraj/mega-ar-525m-v0.07-ultraTBfw
mega-ar-525m-v0.07-ultraTBfw is a text generation model from pszemraj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
14
0% of all-time downloads
All-time downloads
36.3K
Public
Parameters
525M
2.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.1 GB · 100%
From the Hugging Face model README
pretraining experiment:
This model is a fine-tuned version of pszemraj/mega-ar-525m-v0.06-fw_longish on the BEE-spoke-data/UltraTextbooks-2.1-fw_mix dataset. It achieves the following results on the evaluation set:
Quick eval for: pszemraj/mega-ar-525m-v0.07-ultraTBfw
hf (pretrained=pszemraj/mega-ar-525m-v0.07-ultraTBfw,trust_remote_code=True,dtype=float), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 8
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| arc_easy | 1 | none | 0 | acc | 0.4912 | ± | 0.0103 |
| none | 0 | acc_norm | 0.4356 | ± | 0.0102 | ||
| boolq | 2 | none | 0 | acc | 0.6092 | ± | 0.0085 |
| lambada_openai | 1 | none | 0 | perplexity | 49.3787 | ± | 2.0179 |
| none | 0 | acc | 0.3078 | ± | 0.0064 | ||
| openbookqa | 1 | none | 0 | acc | 0.1900 | ± | 0.0176 |
| none | 0 | acc_norm | 0.3060 | ± | 0.0206 | ||
| piqa | 1 | none | 0 | acc | 0.6480 | ± | 0.0111 |
| none | 0 | acc_norm | 0.6480 | ± | 0.0111 | ||
| winogrande | 1 | none | 0 | acc | 0.5209 | ± | 0.0140 |