Downloads · 30 days
130
3% of all-time downloads
RichardErkhov/davzoku_-_frankencria-llama2-11b-v1.3-m.1-gguf
davzoku_-_frankencria-llama2-11b-v1.3-m.1-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
130
3% of all-time downloads
All-time downloads
4.6K
Public
Repo size
113 GB
Likes
0
Public
Click a slice to open those files.
.gguf131 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
frankencria-llama2-11b-v1.3-m.1 - GGUF
inference: false language: en license: llama2 model_type: llama datasets:
The configuration is the same as Undi95/Mistral-11B-v0.1, mlabonne/FrankenBeagle14-11B and the DUS technique used in upstage/SOLAR-10.7B-v1.0.
Please be aware that this model is highly experimental, and no further training has been conducted following the merge. Therefore, the model performance may not meet expectations, as described in the SOLAR paper
FrankenCRIA v1.3 comes with several variants.
This model was merged using the passthrough merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model.
# https://huggingface.co/Undi95/Mistral-11B-v0.1
slices:
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [0, 24]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16