Downloads · 30 days
0
Orca-2-13b-Alpaca-Uncensored-GGUF
athirdpath/Orca-2-13b-Alpaca-Uncensored-GGUF
Orca-2-13b-Alpaca-Uncensored-GGUF is a text generation model from athirdpath. Use it when you need the model to write or continue text. The card lists the license as other.
q80, q6k, q5km, q4km, and q3km GGUF quants of athirdpath/Orca-2-13b-Alpaca-Uncensored.
Access
Public
Updated Dec 6, 2023
Repo size
74 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.bin74 GB · 100%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Nov 27, 2023
- Updated
- Dec 6, 2023
- SHA
- ff01f598
Try a prompt
Model card
From the Hugging Face model README
q8_0, q6_k, q5_k_m, q4_k_m, and q3_k_m GGUF quants of athirdpath/Orca-2-13b-Alpaca-Uncensored.
This model is a fine-tuned version of microsoft/Orca-2-13b on a subset of the Vezora/Mini_Orca_Uncencored_Alpaca dataset, adjusted to demonstrate the relationship between instruction and input, with some particularly spicy prompts added to reduce the risk of rejections.
Only the q_proj and k_proj modules were targeted and a low rank (8) was used, in hopes of containing the adjustments to the prompt format and alignment. This is promising on paper, with the training's per-step loss averaging <0.9 for the last third of the run.
Reasoning stayed solid (for a 13b model) and I consider this a success. Performance is slighty worse than OG Orca-2 in Ooba's chat mode, comparable in Alpaca chat-instruct mode to the OG in ChatLM chat-instruct mode.
May still reject some shocking prompts, but can easily be overcome with author's note or character card.
- Task
- Text Generation
- License
- other
- Languages
- en
- Created
- Nov 27, 2023
- Updated
- Dec 6, 2023