Downloads · 30 days
80
6% of all-time downloads
ddh0_-_OrcaMaid-13b-gguf
RichardErkhov/ddh0_-_OrcaMaid-13b-gguf
ddh0_-_OrcaMaid-13b-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
1.3K
Public
Repo size
130 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf154 GB · 100%
At a glance
- Access
- Public
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024
- SHA
- 99099494
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
OrcaMaid-13b - GGUF
- Model creator: https://huggingface.co/ddh0/
- Original model: https://huggingface.co/ddh0/OrcaMaid-13b/
| Name | Quant method | Size |
|---|---|---|
| OrcaMaid-13b.Q2_K.gguf | Q2_K | 4.52GB |
| OrcaMaid-13b.Q3_K_S.gguf | Q3_K_S | 5.27GB |
| OrcaMaid-13b.Q3_K.gguf | Q3_K | 5.9GB |
| OrcaMaid-13b.Q3_K_M.gguf | Q3_K_M | 5.9GB |
| OrcaMaid-13b.Q3_K_L.gguf | Q3_K_L | 6.45GB |
| OrcaMaid-13b.IQ4_XS.gguf | IQ4_XS | 6.54GB |
| OrcaMaid-13b.Q4_0.gguf | Q4_0 | 6.86GB |
| OrcaMaid-13b.IQ4_NL.gguf | IQ4_NL | 6.9GB |
| OrcaMaid-13b.Q4_K_S.gguf | Q4_K_S | 6.91GB |
| OrcaMaid-13b.Q4_K.gguf | Q4_K | 7.33GB |
| OrcaMaid-13b.Q4_K_M.gguf | Q4_K_M | 7.33GB |
| OrcaMaid-13b.Q4_1.gguf | Q4_1 | 7.61GB |
| OrcaMaid-13b.Q5_0.gguf | Q5_0 | 8.36GB |
| OrcaMaid-13b.Q5_K_S.gguf | Q5_K_S | 8.36GB |
| OrcaMaid-13b.Q5_K.gguf | Q5_K | 8.6GB |
| OrcaMaid-13b.Q5_K_M.gguf | Q5_K_M | 8.6GB |
| OrcaMaid-13b.Q5_1.gguf | Q5_1 | 9.1GB |
| OrcaMaid-13b.Q6_K.gguf | Q6_K | 9.95GB |
| OrcaMaid-13b.Q8_0.gguf | Q8_0 | 12.88GB |
Original model description:
license: other license_name: microsoft-research-license license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE pipeline_tag: text-generation
OrcaMaid-13b
This is a merge of Microsoft's Orca-2-13b and Undi and IkariDev's Noromaid-v0.1.1-13b, with just a touch of Kal'tsit's cat-v1.0 mixed in.
The model recipe was as follows:
- Linear merge of Orca-2-13b @0.8 and cat-v1.0-13b @0.2 = OrcaCat-13b (no plans to release)
- Gradient SLERP merge of Noromaid-v0.1.1 @0.5 and OrcaCat-13b @0.5 = OrcaMaid-13b
Both merges were done in FP32 rather than FP16, due to Orca being released as FP32. I didn't want to risk losing any precision.
The overall goal of this merge is to create a model that sounds uniquely human and natural, without sacrificing intelligence. Edit: after some feedback from a few others, ranking on the Ayumi leaderboards, and more of my own testing, I believe I have succeeded as well as I reasonably could have hoped.
The prompt format is Alpaca. You can use the standard format as shown, but for best results, you should customize the system prompt to your specific needs.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{YOUR MESSAGE HERE}
### Response:
{BOT MESSAGE HERE}
Misc. information
- BOS token is
<s> - EOS token is
</s> - Native context length is
4096 - Base model is Llama 2
- Due to the inclusion of Orca-2-13b, the model is subject to the terms of the Microsoft Research License
Thanks
- Thanks to Charles Goddard for his kind help with mergekit
- Thanks to Undi and IkariDev for Noromaid
- Thanks to Kal'tsit for Cat. See her original reddit post: Cat 1.0 is an uncensored, rp model aligned to be useful in all (even spicy)situations
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024