Downloads · 30 days
9
1% of all-time downloads
schonsense/70B_llama33_stock_unslop
70B_llama33_stock_unslop is a text generation model from schonsense. Use it when you need the model to write or continue text. It is set up for transformers.
An attempt at getting the best of all worlds. Still in testing.
Downloads · 30 days
9
1% of all-time downloads
All-time downloads
851
Public
Parameters
70.6B
141 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors141 GB · 100%
From the Hugging Face model README
An attempt at getting the best of all worlds. Still in testing.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using meta-llama/Llama-3.1-70B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: model_stock
base_model: meta-llama/Llama-3.1-70B
models:
- model: sam-paech/Llama-3.3-70B-Instruct-ftpo_1k
- model: meta-llama/Llama-3.3-70B-Instruct
- model: schonsense/llama33_inst_multivector_derestriction
parameters:
normalize: false
int8_mask: true
dtype: float32
out_dtype: bfloat16
tokenizer:
source: meta-llama/Llama-3.3-70B-Instruct
pad_to_multiple_of: 8