Downloads · 30 days
5
9% of all-time downloads
T3Q-LLM/T3Q-LLM-TE-NLI-v1.0
T3Q-LLM-TE-NLI-v1.0 is a text generation model from T3Q-LLM. Use it when you need the model to write or continue text. It is set up for transformers.
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
Downloads · 30 days
5
9% of all-time downloads
All-time downloads
58
Public
Parameters
10.8B
21.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors21.6 GB · 100%
From the Hugging Face model README
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
[More Information Needed]
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.9551 | ± | 0.0055 |
| macro_f1 | 0.9551 | ± | 0.0055 | ||
| kobest_copa | 0 | acc | 0.7880 | ± | 0.0129 |
| macro_f1 | 0.7876 | ± | 0.0129 | ||
| kobest_hellaswag | 0 | acc | 0.5200 | ± | 0.0224 |
| acc_norm | 0.5460 | ± | 0.0223 | ||
| macro_f1 | 0.5173 | ± | 0.0224 | ||
| kobest_sentineg | 0 | acc | 0.8866 | ± | 0.0159 |
| macro_f1 | 0.8865 | ± | 0.0160 |
hf-causal-experimental (pretrained=intfloat/e5-mistral-7b-instruct,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5021 | ± | 0.0133 |
| macro_f1 | 0.3343 | ± | 0.0059 | ||
| kobest_copa | 0 | acc | 0.4800 | ± | 0.0158 |
| macro_f1 | 0.4796 | ± | 0.0158 | ||
| kobest_hellaswag | 0 | acc | 0.2160 | ± | 0.0184 |
| acc_norm | 0.2560 | ± | 0.0195 | ||
| macro_f1 | 0.2138 | ± | 0.0182 | ||
| kobest_sentineg | 0 | acc | 0.4962 | ± | 0.0251 |
| macro_f1 | 0.3316 | ± | 0.0113 |