Downloads · 30 days
3
10% of all-time downloads
RichardErkhov/grimjim_-_rogue-enchantress-32k-7B-4bits
grimjim_-_rogue-enchantress-32k-7B-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
3
10% of all-time downloads
All-time downloads
31
Public
Parameters
7.4B
4.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.5 GB · 100%
How the weights are stored.
U87B · 95%
From the Hugging Face model README
Quantization made by Richard Erkhov.
rogue-enchantress-32k-7B - bnb 4bits
base_model:
This is a merge of pre-trained language models created using mergekit.
An ambition of this merge was to augment text generation with the potential creative richness of the WizardLM-2 7B and Zephyr-7B-Beta models, the reasoning of the Starling-LM-7B-beta model, and extended context length of Mistral v0.2.
The resulting model is very attentive to character card descriptions and capable of applying reasoning. This model is in the smarter side, following context and formatting. The model is creative and "wants" to write, incorporating details cooperatively and driving plot, with occasional runaway narration if it finds that the prompt leans that way.
Tested with ChatML Instruct prompts, temperature 1.0, and minP 0.02.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: grimjim/zephyr-wizard-kuno-royale-BF16-merge-7B
layer_range: [0,32]
- model: grimjim/cuckoo-starling-7B
layer_range: [0,32]
merge_method: slerp
base_model: grimjim/zephyr-wizard-kuno-royale-BF16-merge-7B
parameters:
t:
- value: 0.5
dtype: bfloat16