Downloads · 30 days
11
3% of all-time downloads
NeverSleep_-_Nethena-20B-gguf
RichardErkhov/NeverSleep_-_Nethena-20B-gguf
NeverSleep_-_Nethena-20B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
316
Public
Repo size
89.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf99 GB · 100%
At a glance
- Access
- Public
- Created
- Jun 5, 2024
- Updated
- Jun 5, 2024
- SHA
- 41136f41
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Nethena-20B - GGUF
- Model creator: https://huggingface.co/NeverSleep/
- Original model: https://huggingface.co/NeverSleep/Nethena-20B/
| Name | Quant method | Size |
|---|---|---|
| Nethena-20B.Q2_K.gguf | Q2_K | 6.91GB |
| Nethena-20B.IQ3_XS.gguf | IQ3_XS | 7.63GB |
| Nethena-20B.IQ3_S.gguf | IQ3_S | 8.06GB |
| Nethena-20B.Q3_K_S.gguf | Q3_K_S | 8.06GB |
| Nethena-20B.IQ3_M.gguf | IQ3_M | 8.53GB |
| Nethena-20B.Q3_K.gguf | Q3_K | 9.04GB |
| Nethena-20B.Q3_K_M.gguf | Q3_K_M | 9.04GB |
| Nethena-20B.Q3_K_L.gguf | Q3_K_L | 9.9GB |
| Nethena-20B.IQ4_XS.gguf | IQ4_XS | 10.01GB |
| Nethena-20B.Q4_0.gguf | Q4_0 | 8.15GB |
| Nethena-20B.IQ4_NL.gguf | IQ4_NL | 2.0GB |
| Nethena-20B.Q4_K_S.gguf | Q4_K_S | 1.44GB |
| Nethena-20B.Q4_K.gguf | Q4_K | 1.01GB |
| Nethena-20B.Q4_K_M.gguf | Q4_K_M | 0.47GB |
| Nethena-20B.Q4_1.gguf | Q4_1 | 0.47GB |
| Nethena-20B.Q5_0.gguf | Q5_0 | 0.47GB |
| Nethena-20B.Q5_K_S.gguf | Q5_K_S | 0.37GB |
| Nethena-20B.Q5_K.gguf | Q5_K | 0.25GB |
| Nethena-20B.Q5_K_M.gguf | Q5_K_M | 0.14GB |
| Nethena-20B.Q5_1.gguf | Q5_1 | 0.1GB |
| Nethena-20B.Q6_K.gguf | Q6_K | 0.07GB |
| Nethena-20B.Q8_0.gguf | Q8_0 | 0.06GB |
Original model description:
license: cc-by-nc-4.0
This model is a collab between IkariDev and Undi!
Nethena-20B model. Use Alpaca format. Suitable for RP, ERP and general stuff.
What would happen if we combine all of out best models? Well.. here it is, the holy grail: Echidna v0.3 + Athena v3 + Nete
This model also has a 13b version, you can check it out right here.
[Recommended settings - No settings yet(Please suggest some over in the Community tab!)]
<!-- description start -->Description
<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->This repo contains fp16 files of Nethena-20B.
<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)--> <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)--> <!--[exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-20B-v0.3-8bpw-8h-exl2)--> <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)--> <!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)--> <!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->Ratings:
Note: We have permission of all users to upload their ratings, i DONT screenshot random reviews without asking if i can put them here!
No ratings yet!
If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
<!-- description end --> <!-- description start -->Models+loras used and recipe
- NeverSleep/Echidna-13b-v0.3
- IkariDev/Athena-v3
- Undi95/Nete-13B
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Others
Undi: If you want to support me, you can here.
IkariDev: Visit my retro/neocities style website please kek
- Created
- Jun 5, 2024
- Updated
- Jun 5, 2024