Downloads · 30 days
9
16% of all-time downloads
T3Q-LLM/T3Q-LMM3-MK-v1.0
T3Q-LMM3-MK-v1.0 is a text generation model from T3Q-LLM. Use it when you need the model to write or continue text. It is set up for transformers.
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LMM3-MK-v1.0,useaccelerate=true,trustremotecode=true), limit: None, providedescription: False, numfewshot: 0, batchsize: 8
Downloads · 30 days
9
16% of all-time downloads
All-time downloads
55
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LMM3-MK-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5613 | ± | 0.0132 |
| macro_f1 | 0.4616 | ± | 0.0128 | ||
| kobest_copa | 0 | acc | 0.6710 | ± | 0.0149 |
| macro_f1 | 0.6705 | ± | 0.0149 | ||
| kobest_hellaswag | 0 | acc | 0.4560 | ± | 0.0223 |
| acc_norm | 0.5940 | ± | 0.0220 | ||
| macro_f1 | 0.4543 | ± | 0.0223 | ||
| kobest_sentineg | 0 | acc | 0.6423 | ± | 0.0241 |
| macro_f1 | 0.6108 | ± | 0.0252 |