Repository navigation
https://sinon.github.io/future-python-type-checkers/ #17
Description
How Well Do New Python Type Checkers Conform? A Deep Dive into Ty, Pyrefly, and Zuban
A comparison of three new Rust-based Python type checkers through the lens of typing spec conformance: Astral's ty, Meta's pyrefly, and David Halter's zuban
Activity
yangdanny97 commentedon Sep 2, 2025
What timing, we added Pyrefly to the conformance leaderboard the same weekend you published this post lol
python/typing#2080
sinon commentedon Sep 3, 2025
Congratulations on the progress @yangdanny97 ! Seeing it side-by-side with pyre really shows the progress you and your team have made, as it's already surpassed pyre on so many aspects on the conformance suite 🚀
Jamie-Chang commentedon Sep 3, 2025
I didn't know the conformance suite existed, definitely useful for evaluating different options (and for convincing people to use pyright)
ewerybody commentedon Jun 24, 2026
Really nice write up!! Thanks! Any chance having these benchmarks with latest versions done more frequently? :)
ewerybody commentedon Jun 24, 2026
OK. Answered it myself :) Its within the original repo now:
https://htmlpreview.github.io/?https://github.com/python/typing/blob/main/conformance/results/results.html
MelbourneDeveloper commentedon Jul 9, 2026
Hi. Basilisk was just added the other day and it scores 100%. Check it out
https://github.com/python/typing/blob/main/conformance/results/results.html
MelbourneDeveloper commentedon Jul 9, 2026
You can read about Basilisk here
https://www.basilisk-python.dev/
Or grab it on vscode
https://marketplace.visualstudio.com/items?itemName=Nimblesite.basilisk