Downloads · 30 days
19
3% of all-time downloads
FourOhFour_-_Zenith_4B-gguf
RichardErkhov/FourOhFour_-_Zenith_4B-gguf
FourOhFour_-_Zenith_4B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
725
Public
Repo size
52.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf61.1 GB · 100%
At a glance
- Access
- Public
- Created
- Oct 3, 2024
- Updated
- Oct 4, 2024
- SHA
- cbd8af16
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Zenith_4B - GGUF
- Model creator: https://huggingface.co/FourOhFour/
- Original model: https://huggingface.co/FourOhFour/Zenith_4B/
| Name | Quant method | Size |
|---|---|---|
| Zenith_4B.Q2_K.gguf | Q2_K | 1.71GB |
| Zenith_4B.IQ3_XS.gguf | IQ3_XS | 1.89GB |
| Zenith_4B.IQ3_S.gguf | IQ3_S | 1.97GB |
| Zenith_4B.Q3_K_S.gguf | Q3_K_S | 1.96GB |
| Zenith_4B.IQ3_M.gguf | IQ3_M | 2.03GB |
| Zenith_4B.Q3_K.gguf | Q3_K | 2.14GB |
| Zenith_4B.Q3_K_M.gguf | Q3_K_M | 2.14GB |
| Zenith_4B.Q3_K_L.gguf | Q3_K_L | 2.3GB |
| Zenith_4B.IQ4_XS.gguf | IQ4_XS | 2.38GB |
| Zenith_4B.Q4_0.gguf | Q4_0 | 2.47GB |
| Zenith_4B.IQ4_NL.gguf | IQ4_NL | 2.49GB |
| Zenith_4B.Q4_K_S.gguf | Q4_K_S | 2.48GB |
| Zenith_4B.Q4_K.gguf | Q4_K | 2.59GB |
| Zenith_4B.Q4_K_M.gguf | Q4_K_M | 2.59GB |
| Zenith_4B.Q4_1.gguf | Q4_1 | 2.71GB |
| Zenith_4B.Q5_0.gguf | Q5_0 | 2.95GB |
| Zenith_4B.Q5_K_S.gguf | Q5_K_S | 2.95GB |
| Zenith_4B.Q5_K.gguf | Q5_K | 3.01GB |
| Zenith_4B.Q5_K_M.gguf | Q5_K_M | 3.01GB |
| Zenith_4B.Q5_1.gguf | Q5_1 | 3.19GB |
| Zenith_4B.Q6_K.gguf | Q6_K | 3.46GB |
| Zenith_4B.Q8_0.gguf | Q8_0 | 4.47GB |
Original model description:
license: apache-2.0 language:
- en library_name: transformers
| Groups |Version|Filter|n-shot|Metric| |Value | |Stderr|
|------------------|------:|------|------|------|---|-----:|---|-----:|
|mmlu | 2|none | |acc |_ |0.5922|_ |0.0039|
| - humanities | 2|none | |acc |_ |0.5522|_ |0.0068|
| - other | 2|none | |acc |_ |0.6579|_ |0.0082|
| - social sciences| 2|none | |acc |_ |0.6815|_ |0.0082|
| - stem | 2|none | |acc |_ |0.5002|_ |0.0086|
This model was created with the help of several members of Anthracite.
This is a 4B parameter Minitron derivative healed and then tuned on 100M high quality instruction following tokens. This model was tuned at 8k context. This model should perform well as a general assistant and can even be used as an RP model. Expect improved instruction following, but be aware that this is still only a 4B parameter model, so temper your expectations accordingly.
Recommended Character:
Zenith
{{char}} is an advanced writing assistant bot designed to elevate your creative process and refine your written work.
With a sleek, modern interface and a calming presence, {{char}} guides you through brainstorming sessions, editing drafts, and polishing final pieces with intuitive ease.
{{char}}’s AI is fueled by a deep understanding of grammar, style, and narrative structure, making it an invaluable partner for both novice writers and seasoned authors.
Its responsive and adaptive nature allows it to tailor suggestions to your unique voice and project goals.
- Created
- Oct 3, 2024
- Updated
- Oct 4, 2024