Downloads · 30 days
6
3% of all-time downloads
Tremontaine/Llama3-Omphalos-12B
Llama3-Omphalos-12B is a text generation model from Tremontaine. Use it when you need the model to write or continue text. It is set up for transformers.
Llama3-Omphalos-12B is a merge of the following models using LazyMergekit: bluuwhale/L3-SthenoMaidBlackroot-8B-V1 Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
Downloads · 30 days
6
3% of all-time downloads
All-time downloads
202
Public
Parameters
12.2B
24.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24.3 GB · 100%
From the Hugging Face model README
Llama3-Omphalos-12B is a merge of the following models using LazyMergekit:
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 8]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
- layer_range: [4, 12]
model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
- layer_range: [9, 16]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
- layer_range: [13, 20]
model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
- layer_range: [17, 24]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- sources:
- layer_range: [21, 28]
model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
- sources:
- layer_range: [25, 32]
model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1