Downloads · 30 days
0
Envoid/MindFlay-22B-ggml
MindFlay-22B-ggml is a machine learning model from Envoid. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is an experiment using the frankenstein script from https://huggingface.co/chargoddard/llama2-22b Except I decided to use it with two models that have already been extensively finetuned. With https://huggin…
Downloads · 30 days
0
Access
Public
Updated Jul 23, 2023
Repo size
35.5 GB
Likes
1
Public
Click a slice to open those files.
.bin35.5 GB · 100%
From the Hugging Face model README
This model is an experiment using the frankenstein script from https://huggingface.co/chargoddard/llama2-22b Except I decided to use it with two models that have already been extensively finetuned. With https://huggingface.co/TheBloke/Llama-2-13B-Chat-fp16 as the base model and https://huggingface.co/Aeala/Enterredaas-33b as the donor model.
The resulting model is surprisingly coherent and still responds well to the llama2chat prompt format
[INST]<<SYS>><</SYS>>[/INST] and still has most of llama2chat's bubbly/giddy personality but more gritty and visceral.
It makes occasional "typos" along with some other quirks so it was not completely unscathed by the frankensteining process.
I plan to massage it over with a LoRA in the near future to bring it into more harmony but in the meantime it is available now for your enjoyment.
Use cases: Chat/RP not much else.