Downloads · 30 days
29
24% of all-time downloads
olmo-13b-gguf
llmware/olmo-13b-gguf
olmo-13b-gguf is a machine learning model from llmware. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
olmo-13b-gguf is a GGUF Q4KM quantized version of Allen AI Olmo 2 13B Instruct, providing a fast, small inference implementation, optimized for AI PCs.
All-time downloads
119
Public
Repo size
8.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf8.4 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- olmo2
- Access
- Public
- Created
- Dec 27, 2025
- Updated
- Dec 27, 2025
- SHA
- eea74602
Base models
Model card
From the Hugging Face model README
olmo-13b-gguf
<!-- Provide a quick summary of what the model is/does. -->olmo-13b-gguf is a GGUF Q4_K_M quantized version of Allen AI Olmo 2 13B Instruct, providing a fast, small inference implementation, optimized for AI PCs.
Model Description
- Developed by: AllenAI
- Quantized by: bartowksi
- Model type: olmo2
- Parameters: 13 billion
- Model Parent: allenai/OLMo-2-1124-13B-Instruct
- Language(s) (NLP): English
- License: Apache 2.0
- Uses: Chat, general-purpose LLM
- Quantization: int4
Model Card Contact
- Type
- olmo2
- License
- apache-2.0
- Created
- Dec 27, 2025
- Updated
- Dec 27, 2025