Olmo-3-7B-Think-GGUF

Static quant of https://huggingface.co/allenai/Olmo-3-7B-Instruct

Model Description

• Developed by: Allen Institute for AI (Ai2)
• Model type: a Transformer style autoregressive language model.
• Language(s) (NLP): English
• License: This model is licensed under Apache 2.0. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines.
• Contact: Technical inquiries: [email protected]. Press: [email protected]
• Date cutoff: Dec. 2024.

Model Sources

• Project Page: https://allenai.org/olmo
• Repositories:
  • Open-Instruct for DPO and RLVR: https://github.com/allenai/open-instruct
  • OLMo-Core for pre-training and SFT: https://github.com/allenai/OLMo-core
  • OLMo-Eval for evaluation: https://github.com/allenai/OLMo-Eval
• Paper: [TBD]

<!-- - **Technical blog post:** (URL) --> <!-- - **W&B Logs:** [SFT](()), [DPO](()), [RLVR](()) -->

Evaluation

Model Details

Stage 1: SFT

• supervised fine-tuning on the Dolci-Think-SFT-7B dataset. This dataset consits of math, code, chat, and general knowledge queries.
• Datasets: Dolci-Think-SFT-7B, Dolci-Instruct-SFT-7B

Stage 2:DPO

• direct preference optimization on the Dolci-Think-DPO-7B dataset. This dataset consits of math, code, chat, and general knowledge queries.
• Datasets: Dolci-Think-DPO-7B, Dolci-Instruct-DPO-7B

Stage 3: RLVR

• reinforcement learning from verifiable rewards on the Dolci-Think-RL-7B dataset. This dataset consits of math, code, instruction-following, and general chat queries.
• Datasets: Dolci-Think-RL-7B, Dolci-Instruct-RL-7B

Inference & Recommended Settings

We evaluated our models on the following settings. We also recommend using them for generation:

• temperature: 0.6
• top_p: 0.95
• max_tokens: 32768