Downloads · 30 days
23
7% of all-time downloads
olmo7-think-sft-hyp
zimplex/olmo7-think-sft-hyp
olmo7-think-sft-hyp is a text generation model from zimplex. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Thinking-SFT of allenai/Olmo-3-1025-7B on allenai/Dolci-Think-SFT-7B with a hyperbolic (Lorentzian) output head (output-only, curvature c = 0.05), trained with the <think ChatML template.
All-time downloads
320
Public
Parameters
7.8B
16.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.6 GB · 94%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- olmo3
- Access
- Public
- Created
- Aug 6, 2026
- Updated
- Aug 6, 2026
- SHA
- 07590b35
Try a prompt
Base models
Model card
From the Hugging Face model README
zimplex/olmo7-think-sft-hyp
Thinking-SFT of allenai/Olmo-3-1025-7B on allenai/Dolci-Think-SFT-7B with a hyperbolic (Lorentzian) output
head (output-only, curvature c = 0.05), trained with the <think> ChatML template.
IMPORTANT — the hyperbolic head is not the standard lm_head
A plain AutoModelForCausalLM.from_pretrained(...) loads the euclidean head and gives the WRONG
model. To use the hyperbolic head you must load hyp_head_state.pt and swap the output head using
the training repo's code (scripts/eval_think.py → load_hyp_head / HyperbolicLMHead; the vLLM
path mirrors it). hyp_head_state.pt is authoritative for curvature / scale / projection / adapter.
Prompting & grading
Use the repo's <think> template (openrlhf/utils/think_chat.py); greedy decoding. Take the answer
after </think> (last \boxed{} / #### / number) and grade math with math_verify.
Files
Standard HF Olmo3 weights + tokenizer + chat_template.jinja, plus hyp_head_state.pt
(vocab_emb, down_proj, log_input_scale, log_temp, curvature).
- Task
- Text Generation
- Type
- olmo3
- License
- apache-2.0
- Created
- Aug 6, 2026
- Updated
- Aug 6, 2026