Downloads · 30 days
19
0% of all-time downloads
T3Q-LLM3-NC-v1.0
T3Q-LLM/T3Q-LLM3-NC-v1.0
T3Q-LLM3-NC-v1.0 is a text generation model from T3Q-LLM. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
All-time downloads
31K
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 8, 2024
- Updated
- May 28, 2024
- SHA
- c1672aa1
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: [More Information Needed]
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Model type: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
- Finetuned from model [optional]: [More Information Needed]
Model Sources [optional]
<!-- Provide the basic links for the model. -->- Repository: [More Information Needed]
- Paper [optional]: [More Information Needed]
- Demo [optional]: [More Information Needed]
Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->Evaluation
hf (pretrained=T3Q-LLM/T3Q-LLM3-NC-v1.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.6781 | ± | 0.0125 |
| macro_f1 | 0.6514 | ± | 0.0131 | ||
| kobest_copa | 0 | acc | 0.6820 | ± | 0.0147 |
| macro_f1 | 0.6816 | ± | 0.0147 | ||
| kobest_hellaswag | 0 | acc | 0.4300 | ± | 0.0222 |
| acc_norm | 0.5360 | ± | 0.0223 | ||
| macro_f1 | 0.4286 | ± | 0.0221 | ||
| kobest_sentineg | 0 | acc | 0.5819 | ± | 0.0248 |
| macro_f1 | 0.5020 | ± | 0.0252 |
hf-causal-experimental (pretrained=beomi/Llama-3-Open-Ko-8B-Instruct-preview,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.6766 | ± | 0.0125 |
| macro_f1 | 0.6493 | ± | 0.0131 | ||
| kobest_copa | 0 | acc | 0.6850 | ± | 0.0147 |
| macro_f1 | 0.6846 | ± | 0.0147 | ||
| kobest_hellaswag | 0 | acc | 0.4280 | ± | 0.0221 |
| acc_norm | 0.5380 | ± | 0.0223 | ||
| macro_f1 | 0.4265 | ± | 0.0221 | ||
| kobest_sentineg | 0 | acc | 0.5844 | ± | 0.0248 |
| macro_f1 | 0.5085 | ± | 0.0253 |
hf-causal-experimental (pretrained=beomi/Llama-3-Open-Ko-8B,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5627 | ± | 0.0132 |
| macro_f1 | 0.4764 | ± | 0.0130 | ||
| kobest_copa | 0 | acc | 0.7570 | ± | 0.0136 |
| macro_f1 | 0.7565 | ± | 0.0136 | ||
| kobest_hellaswag | 0 | acc | 0.4780 | ± | 0.0224 |
| acc_norm | 0.5960 | ± | 0.0220 | ||
| macro_f1 | 0.4740 | ± | 0.0223 | ||
| kobest_sentineg | 0 | acc | 0.7481 | ± | 0.0218 |
| macro_f1 | 0.7424 | ± | 0.0222 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Featherless Ai
- live
- Created
- May 8, 2024
- Updated
- May 28, 2024