FrontierMath Created 2025-02-11 Updated 2025-07-16
arstechnica.com/ai/2024/11/new-secret-math-benchmark-stumps-ai-models-and-phds-alike/ mentions what the official website is unable to clearly state out:
The design of FrontierMath differs from many existing AI benchmarks because the problem set remains private and unpublished to prevent data contamination
So yeah, fuck off.
The expected answer output for all problems is just one single, possibly ridiculously large, integer, which is kind of a cool approach. Similar to Project Euler in that aspect.
The most interesting aspect of this benchmark is the difficulty. Mathematical olympiad coach Evan Chen comments:[ref]
Problems in [the International Mathematical Olympiad] typically require creative insight while avoiding complex implementation and specialized knowledge [but for FrontierMath] they keep the first requirement, but outright invert the second and third requirement
facecheck.id Created 2025-02-11 Updated 2025-07-16
Became paid in 2024: www.reddit.com/r/OSINT/comments/1awkxbi/facecheckid_will_no_longer_be_free/ You can search, it and lists which social media websites it found the hits on, but does not give the full URLs.
Had one possible non-trivial LinkedIn hit for Ross Ulbricht's wife in early 2025, before her identity was publicly known, so they may have something actually going on there
Closed source benchmark Created 2025-02-11 Updated 2025-07-16
Open source benchmark Created 2025-02-11 Updated 2025-07-16
AI Math benchmark Created 2025-02-11 Updated 2025-07-16
Percolation theory Created 2025-02-11 Updated 2025-07-16
This field is likely both ugly and useless.
OK, in 2D they've achieved some cute rational number results. But still.
Open and closed source benchmarks Created 2025-02-11 Updated 2025-07-16
Percolation Created 2025-02-11 Updated 2025-07-16
meetup.com Created 2025-02-11 Updated 2025-07-16
2022 Fields Medal winner Created 2025-02-11 Updated 2025-07-16
2022 Fields Medal Created 2025-02-11 Updated 2025-07-16
Statistical mechanics model Created 2025-02-11 Updated 2025-07-16
Hugo Duminil-Copin Created 2025-02-11 Updated 2025-07-16
Person related to Ross Ulbricht Created 2025-01-29 Updated 2025-07-16
Wayback Machine pages don't after you just finished archiving them Created 2025-01-29 Updated 2025-07-16
Pages seem to take some time after they say they have "archived it" to when you can actually see what was archived.
Their system is that bad unsurprisingly.
Molecule representation Created 2025-01-29 Updated 2025-07-16
Temperature-composition phase diagram Created 2025-01-29 Updated 2025-07-16
Composition phase diagram Created 2025-01-29 Updated 2025-07-16
Composition phase diagrams are phase diagrams that also consider variations in composition of a mixture. The most classic of such diagrams are temperature-composition phase diagrams for binary alloys.

There are unlisted articles, also show them or only show them.