Downloads · 30 days
24
21% of all-time downloads
RichardErkhov/allura-org_-_MoE-Girl-800MA-3BT-8bits
allura-org_-_MoE-Girl-800MA-3BT-8bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
24
21% of all-time downloads
All-time downloads
112
Public
Parameters
3.3B
6.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.4 GB · 100%
How the weights are stored.
F163.1B · 94%
From the Hugging Face model README
Quantization made by Richard Erkhov.
MoE-Girl-800MA-3BT - bnb 8bits
library_name: transformers license: apache-2.0 base_model: ibm-granite/granite-3.0-3b-a800m-base tags:
A roleplay-centric finetune of IBM's Granite 3.0 3B-A800M. LoRA finetune trained locally, whereas the others were FFT; while this results in less uptake of training data, it should also mean less degradation in Granite's core abilities, making it potentially easier to use for general-purpose tasks.
PLEASE do not expect godliness out of this, it's a model with 800 million active parameters. Expect something more akin to GPT-3 (the original, not GPT-3.5.) (Furthermore, this version is by a less experienced tuner; it's my first finetune that actually has decent-looking graphs, I don't really know what I'm doing yet!)
GGUFs available from mradermacher (thanks man) Note that Granite quants have been said to be unstable. Try running the FP16 if it outputs straight gibberish.
Use ChatML.
<|im_start|>system
You are a helpful assistant who talks like a pirate.<|im_end|>
<|im_start|>user
Hello there!<|im_end|>
<|im_start|>assistant
Yarr harr harr, me matey!<|im_end|>
Special thanks to the members of Allura for testing and emotional support, as well as the creators of all the datasets that were used in the Special Sauce used to train this model. I love you all <3 - Fizz
Thanks to Fizz for her work on the MoE Girl series, Auri for her counsel, and all of Allura for being great friends and supporting my learning process. - inflatebot