Downloads · 30 days
73
2% of all-time downloads
RichardErkhov/Ba2han_-_HermesStar-OrcaWind-Synth-11B-gguf
Ba2han_-_HermesStar-OrcaWind-Synth-11B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
73
2% of all-time downloads
All-time downloads
3.7K
Public
Repo size
122 GB
Likes
0
Public
Click a slice to open those files.
.gguf141 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
HermesStar-OrcaWind-Synth-11B - GGUF
license: apache-2.0 language:
Open Hermes + Starling passthrough merged
SlimOrca(?)+Zephyr Beta linear merged, then passthrough merged with Synthia
Then both models were merged again in 1 to 0.3 ratio.
Increasing repetition penalty usually makes the model smarter up to a degree but it also causes stability issues.
Since most of the merged models were trained with ChatML, use ChatML template. Rarely the model throws another EOS token though.
I don't know what I am doing, you are very welcome to put the model through benchmarks.
I'll also upload q6 GGUF but my internet is shit, so don't hesitate to share other quantizations.