Downloads · 30 days
29
14% of all-time downloads
LeanFormalizer_SFT
SJTULean/LeanFormalizer_SFT
LeanFormalizer_SFT is a machine learning model from SJTULean. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Based on Qwen2.5-7b and trained on our LeanStatementSFT dataset, our model achieves state-of-the-art performance in formal mathematics verification, with a pass@1 compilation success rate of 94.1% (459/488) on MiniF2F…
All-time downloads
205
Public
Parameters
7.6B
15.2 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Dec 24, 2024
- Updated
- Dec 25, 2024
- SHA
- 98430bc3
Base models
Datasets
Model card
From the Hugging Face model README
LeanFormalizer_SFT
<!-- Provide a quick summary of what the model is/does. -->Based on Qwen2.5-7b and trained on our LeanStatement_SFT dataset, our model achieves state-of-the-art performance in formal mathematics verification, with a pass@1 compilation success rate of 94.1% (459/488) on MiniF2F and 75.4% (282/374) on ProofNet benchmarks as of December 2024(while our PPO model achieves 95.3% on MiniF2F and 76.0% on Proofnet). These results demonstrate the effectiveness of scaling laws in mathematical formalization using the Lean theorem prover.
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Dec 24, 2024
- Updated
- Dec 25, 2024