Downloads · 30 days
392
3% of all-time downloads
davzoku/frankencria-llama2-12.5b-v1.3-m.2
frankencria-llama2-12.5b-v1.3-m.2 is a text generation model from davzoku. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
<p align="center" <img src="https://github.com/davzoku/cria/blob/main/assets/frankencria-icon-512x512.png?raw=true" width="300" height="300" alt="FrankenCRIA Logo" <br <iThis is a frankenmerge of <a href="https://hugg…
Downloads · 30 days
392
3% of all-time downloads
All-time downloads
12.3K
Public
Parameters
12.4B
24.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24.8 GB · 100%
From the Hugging Face model README
The configuration is the same as vilm/vinallama-12.5b-chat-DUS.
Please be aware that this model is highly experimental, and no further training has been conducted following the merge. Therefore, the model performance may not meet expectations, as described in the SOLAR paper
FrankenCRIA v1.3 comes with several variants.
This model was merged using the passthrough merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
# https://huggingface.co/vilm/vinallama-12.5b-chat-DUS
slices:
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [0, 16]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [8, 16]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [8, 16]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [16, 24]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [16, 24]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [24, 28]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [24, 28]
- sources:
- model: davzoku/cria-llama2-7b-v1.3
layer_range: [28, 32]
merge_method: passthrough
dtype: bfloat16