Downloads · 30 days
108
1% of all-time downloads
Abiray/Leanstral-1.5-119B-A6B-Q4KM-GGUF
Leanstral-1.5-119B-A6B-Q4KM-GGUF is a machine learning model from Abiray. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains the GGUF quantized version (Q4KM) of mistralai/Leanstral-1.5-119B-A6B.
Downloads · 30 days
108
1% of all-time downloads
All-time downloads
13.1K
Public
Repo size
72.2 GB
Likes
12
Public
Click a slice to open those files.
.gguf72.2 GB · 100%
From the Hugging Face model README
This repository contains the GGUF quantized version (Q4_K_M) of mistralai/Leanstral-1.5-119B-A6B.

Leanstral 1.5 is an open-source code agent model designed for Lean 4, a proof assistant capable of expressing complex mathematical objects such as perfectoid spaces and software specifications like properties of Rust fragments.
Built as part of the Mistral Small 4 family, it combines multimodal capabilities and an efficient architecture, making it both performant and cost-effective compared to existing closed-source alternatives.
[!Note] This is an updated model of the previously released Leanstral model.
Leanstral incorporates the following architectural choices:
'none' → Do not use reasoning'high' → Use reasoning (recommended for complex prompts).Because this is a GGUF file, you can run it locally using llama.cpp or other GGUF-compatible inference frameworks. Due to the 119B parameter scale, ensure your system has enough combined VRAM/RAM to host a ~70-80GB model file.
You can spin up a local server that mimics the OpenAI API layout, making it easy to drop into agent workflows or VS Code extensions:
./llama-server \
-m Leanstral-1.5-119B-A6B-Q4_K_M.gguf \
-c 32768 \
--port 8080 \
--n-gpu-layers 99