Leanstral 1.5: Proof Abundance for All
Summary
Mistral AI has released Leanstral 1.5, an open source model that significantly improves its mathematical formal verification and proof engineering capabilities.
Key Points
- Leanstral 1.5 is fully open sourced under the Apache 2.0 license and has 6 billion active parameters.
- It achieved the highest level of mathematical proof performance ever, including saturating the miniF2F benchmark and solving 587 out of 672 PutnamBench problems.
- Through reinforcement learning (RL) in a multi-turn environment and a code agent environment, we found five previously undiscovered bugs in an actual open source repository.
Notable Quotes & Details
Notable Data / Quotes
- 6B active parameters
- 587/672 PutnamBench
- FATE-H (87%)
- FATE-X (34%)
- 5 previously unknown bugs across 57 repositories
Intended Audience
Mathematics researcher, formal verification and Lean 4 developer, AI researcher