Downloads · 30 days
9
20% of all-time downloads
omega-12b-test
SuperbEmphasis/omega-12b-test
omega-12b-test is a text generation model from SuperbEmphasis. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit. This model will be very repetitive and not function well. After removing the layers, I found the model a bit unsuable. However I am currently craf…
All-time downloads
45
Public
Parameters
11.2B
22.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors22.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- May 28, 2025
- Updated
- May 28, 2025
- SHA
- c7ece66b
Try a prompt
Model card
From the Hugging Face model README
The-Omega-Directive-12B-v1.0
This is a merge of pre-trained language models created using mergekit. This model will be very repetitive and not function well. After removing the layers, I found the model a bit unsuable. However I am currently crafting a small RP dataset based off of synthetic data from Claude 3.7 and Haiku 3.5 to retrain the smaller models.
Merge Details
Merge Method
This model was merged using the Passthrough merge method.
Models Merged
The following models were included in the merge:
- /storage/bases/The-Omega-Directive-M-12B-v1.0
Configuration
The following YAML configuration was used to produce this model:
dtype: bfloat16
merge_method: passthrough
modules:
default:
slices:
- sources:
- layer_range: [0, 25]
model: /storage/bases/The-Omega-Directive-M-12B-v1.0
- sources:
- layer_range: [27, 29]
model: /storage/bases/The-Omega-Directive-M-12B-v1.0
- sources:
- layer_range: [31, 40]
model: /storage/bases/The-Omega-Directive-M-12B-v1.0
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- May 28, 2025
- Updated
- May 28, 2025