Downloads · 30 days
11
0% of all-time downloads
T3Q-LLM/T3Q-LLM-solar10.8-sft-v1.0
T3Q-LLM-solar10.8-sft-v1.0 is a text generation model from T3Q-LLM. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
11
0% of all-time downloads
All-time downloads
33.4K
Public
Parameters
10.8B
21.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors21.6 GB · 100%
From the Hugging Face model README

hf (pretrained=T3Q-LLM/T3Q-LLM-solar10.8-sft-v1.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.9288 | ± | 0.0069 |
| macro_f1 | 0.9286 | ± | 0.0069 | ||
| kobest_copa | 0 | acc | 0.7440 | ± | 0.0138 |
| macro_f1 | 0.7434 | ± | 0.0138 | ||
| kobest_hellaswag | 0 | acc | 0.4880 | ± | 0.0224 |
| acc_norm | 0.5600 | ± | 0.0222 | ||
| macro_f1 | 0.4854 | ± | 0.0224 | ||
| kobest_sentineg | 0 | acc | 0.8589 | ± | 0.0175 |
| macro_f1 | 0.8589 | ± | 0.0175 |
hf (pretrained=yanolja/EEVE-Korean-Instruct-10.8B-v1.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.9188 | ± | 0.0073 |
| macro_f1 | 0.9185 | ± | 0.0073 | ||
| kobest_copa | 0 | acc | 0.7520 | ± | 0.0137 |
| macro_f1 | 0.7516 | ± | 0.0136 | ||
| kobest_hellaswag | 0 | acc | 0.4840 | ± | 0.0224 |
| acc_norm | 0.5580 | ± | 0.0222 | ||
| macro_f1 | 0.4804 | ± | 0.0223 | ||
| kobest_sentineg | 0 | acc | 0.8514 | ± | 0.0179 |
| macro_f1 | 0.8508 | ± | 0.0180 |