Downloads · 30 days
268
73% of all-time downloads
The-Omega-Directive-12B-EVISCERATED-FT
SuperbEmphasis/The-Omega-Directive-12B-EVISCERATED-FT
The-Omega-Directive-12B-EVISCERATED-FT is a text generation model from SuperbEmphasis. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
367
Public
Parameters
10.6B
21.2 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors21.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jun 13, 2025
- Updated
- Jun 16, 2025
- SHA
- 751244bc
Try a prompt
Base models
Model card
From the Hugging Face model README
omg it almost works!
I stripped out the 5 least used layers. and then I used SFT over 4 epochs and a high learning rate.... and its almost good!
My goal is to make a new Velvet eclipse with these "less used" paramets stripped out. reducing the size significantly to allow for a higher inference speed, and more room for context.
NOTES
per_device_train_batch_size = 10,
gradient_accumulation_steps = 4,
num_train_epochs = 4, # Set this for 1 full training run.
learning_rate = 5e-4, # Reduce to 2e-5 for long training runs
Uploaded finetuned model
- Developed by: SuperbEmphasis
- License: apache-2.0
- Finetuned from model : SuperbEmphasis/The-Omega-Directive-12B-EVISCERATED
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Jun 13, 2025
- Updated
- Jun 16, 2025