Downloads · 30 days
4
3% of all-time downloads
jamesesqueleto/ornith_9b_enhancedreasoning
ornith_9b_enhancedreasoning is a machine learning model from jamesesqueleto. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A fine-tune of Ornith 9B aimed at strengthening its reasoning ability beyond the base release.
Downloads · 30 days
4
3% of all-time downloads
All-time downloads
141
Public
Parameters
9.4B
18.8 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors18.8 GB · 100%
From the Hugging Face model README
A fine-tune of Ornith 9B aimed at strengthening its reasoning ability beyond the base release.
Fine-tuned on SupraLabs/reasoning-summaries-61k, a 61k-sample dataset of reasoning traces paired with structured summaries covering math, code, tool-use, and multi-step problem solving.
| Hyperparameter | Value |
|---|---|
| Learning rate | 5e-5 |
| LR scheduler | cosine |
| Epochs | 3.0 |
| Batch size | 2 |
| Gradient accumulation | 8 |
| Max gradient norm | 1.0 |
| Cutoff length | 10200 |
| Compute type | bf16 |
| Val size | 0 |
Loss dropped sharply in the first ~200 steps and settled into a steady decline from ~0.65 to ~0.50 over roughly 11k steps, with no signs of divergence or overfitting.
Released as safetensors checkpoints (BF16), ready to drop into standard transformers-based loading pipelines.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "jamesesqueleto/ornith_9b_enhancedreasoning"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="bfloat16", device_map="auto")
This is a fine-tune, not an from-scratch model — general capabilities and limitations of the base Ornith 9B model still apply. Feedback and issues welcome via the Community tab.