180 Million Lines of Proof: How Claude Just Changed Software Safety
Anthropic and Theorem have demonstrated that AI can automatically generate mathematical proofs for code, uncovering hidden bugs while imposing strict hardware limitations on the method.
By Mykola Bondarenko ·

Software verification has historically been a game for the elite, requiring years of human labor to prove that even small systems are error-free. Now, that barrier is collapsing. Anthropic has revealed that its Claude model can independently write and check mathematical proofs of code correctness, a shift that could fundamentally alter how developers trust automated software.
The core achievement involves the generation of roughly 180 million lines of proof code. This massive output was produced in just a few weeks by the Frontier Red Team, working alongside partner Theorem. The effort focused on 123 open-source libraries from Google's OSS-Fuzz security project. Instead of creating new software, Claude translated existing crash tests into mathematical problems and analyzed the compiled machine code to ensure accuracy.
An independent verification program named Rocq automatically checks these generated proofs. Anthropic describes the process as fully autonomous, meaning it requires almost no human reviewers. However, the underlying formal foundations and tools were still built by humans at Theorem. This setup allows the AI to handle the heavy lifting of proof generation without needing a specialist team for every line of code.
The process has already proved valuable beyond just verification. While working on the proofs, Claude identified hundreds of bugs that conventional testing had missed. Many of these issues only appear under very specific conditions, such as unusually large input files or particular access sequences. In one notable instance, the team found as many security bugs in a widely used PDF reader in a single week as are typically reported in an entire year. In another case, a logical error that had gone undetected for over a decade was caught by the model.
Despite the success, significant caveats remain. Anthropic emphasizes that formally verified does not mean completely error-free. The proofs hold only under strict conditions, including a specific processor architecture, single-threaded programs, and inputs under 64 MB. Real-world libraries often run on different hardware and configurations, meaning this method is not yet a universal solution. Additionally, the compute cost is steep, with individual proofs consuming hundreds of millions of tokens.
Efficiency is improving, however. Newer models like Opus 5.5 are solving half the proofs with about 40 percent fewer tokens than the previous version. Theorem's roadmap now targets critical infrastructure components like glibc, OpenSSL, and cURL. If AI can verify its own code under defined conditions, the industry may move toward a standard where formal verification is as routine as basic testing. This could reduce the overall cost of the coding process and increase confidence in AI-generated software.
The question is no longer whether AI can program, but whether it can prove that the code is safe. The answer appears to be yes, at least within specific boundaries. As the cost of verification drops, the implications for software automation could extend well beyond current coding tools, potentially reshaping how critical systems are built and maintained in the coming years.
Source: The Decoder





