Downloads · 30 days
82
7% of all-time downloads
RicardoEstep/RPBizkitRemiX-v1-12B
RPBizkitRemiX-v1-12B is a text generation model from RicardoEstep. Use it when you need the model to write or continue text. It is set up for transformers.
"Experimental Own Mix" using... "Model Stock merge using Mergekit".
Downloads · 30 days
82
7% of all-time downloads
All-time downloads
1.1K
Public
Parameters
12.2B
24.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
"Experimental Own Mix" using... "Model Stock merge using Mergekit".
This is a "RemiX" of all my models in one using RicardoEstep/RPBizkit-v6-12B as base.
This one was merged using "32GBs of RAM", i tried to mix all models equaly, and giving all their data have same importance.

The following models were included in the merge:
It's actually pretty stable as "V6 version", with a "Clean Tokenizer & Embedding Sizes (131072)" based on "Mistral". But, the model will drift if any "Chat Template" is used. The recommended chat template to use is "Alpaca (with "RAW" inputs)". The configuration files are already "Tweaked", to don't use any "Chat Template".
While it's supposed to support a "128K (131072)" context size. The recommended max context size is "8K (8192)", as is a "LLaMA 3 limitation".