Downloads · 30 days
56
7% of all-time downloads
T3Q-LLM_-_T3Q-LLM2-FP-v2.0-gguf
RichardErkhov/T3Q-LLM_-_T3Q-LLM2-FP-v2.0-gguf
T3Q-LLM_-_T3Q-LLM2-FP-v2.0-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
755
Public
Repo size
108 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf127 GB · 100%
At a glance
- Access
- Public
- Created
- Nov 11, 2024
- Updated
- Nov 11, 2024
- SHA
- c0b80cc2
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
T3Q-LLM2-FP-v2.0 - GGUF
- Model creator: https://huggingface.co/T3Q-LLM/
- Original model: https://huggingface.co/T3Q-LLM/T3Q-LLM2-FP-v2.0/
| Name | Quant method | Size |
|---|---|---|
| T3Q-LLM2-FP-v2.0.Q2_K.gguf | Q2_K | 3.73GB |
| T3Q-LLM2-FP-v2.0.Q3_K_S.gguf | Q3_K_S | 4.34GB |
| T3Q-LLM2-FP-v2.0.Q3_K.gguf | Q3_K | 4.84GB |
| T3Q-LLM2-FP-v2.0.Q3_K_M.gguf | Q3_K_M | 4.84GB |
| T3Q-LLM2-FP-v2.0.Q3_K_L.gguf | Q3_K_L | 5.26GB |
| T3Q-LLM2-FP-v2.0.IQ4_XS.gguf | IQ4_XS | 5.43GB |
| T3Q-LLM2-FP-v2.0.Q4_0.gguf | Q4_0 | 5.66GB |
| T3Q-LLM2-FP-v2.0.IQ4_NL.gguf | IQ4_NL | 5.72GB |
| T3Q-LLM2-FP-v2.0.Q4_K_S.gguf | Q4_K_S | 5.7GB |
| T3Q-LLM2-FP-v2.0.Q4_K.gguf | Q4_K | 6.02GB |
| T3Q-LLM2-FP-v2.0.Q4_K_M.gguf | Q4_K_M | 6.02GB |
| T3Q-LLM2-FP-v2.0.Q4_1.gguf | Q4_1 | 6.27GB |
| T3Q-LLM2-FP-v2.0.Q5_0.gguf | Q5_0 | 6.89GB |
| T3Q-LLM2-FP-v2.0.Q5_K_S.gguf | Q5_K_S | 6.89GB |
| T3Q-LLM2-FP-v2.0.Q5_K.gguf | Q5_K | 7.08GB |
| T3Q-LLM2-FP-v2.0.Q5_K_M.gguf | Q5_K_M | 7.08GB |
| T3Q-LLM2-FP-v2.0.Q5_1.gguf | Q5_1 | 7.51GB |
| T3Q-LLM2-FP-v2.0.Q6_K.gguf | Q6_K | 8.2GB |
| T3Q-LLM2-FP-v2.0.Q8_0.gguf | Q8_0 | 10.62GB |
Original model description:
library_name: transformers license: apache-2.0
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: [More Information Needed]
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Model type: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
- Finetuned from model [optional]: [More Information Needed]
Model Sources [optional]
<!-- Provide the basic links for the model. -->- Repository: [More Information Needed]
- Paper [optional]: [More Information Needed]
- Demo [optional]: [More Information Needed]
Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->Evaluation
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM2-FP-v2.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5085 | ± | 0.0133 |
| macro_f1 | 0.3496 | ± | 0.0076 | ||
| kobest_copa | 0 | acc | 0.7680 | ± | 0.0134 |
| macro_f1 | 0.7677 | ± | 0.0134 | ||
| kobest_hellaswag | 0 | acc | 0.4920 | ± | 0.0224 |
| acc_norm | 0.5740 | ± | 0.0221 | ||
| macro_f1 | 0.4889 | ± | 0.0223 | ||
| kobest_sentineg | 0 | acc | 0.6826 | ± | 0.0234 |
| macro_f1 | 0.6616 | ± | 0.0244 |
- Created
- Nov 11, 2024
- Updated
- Nov 11, 2024