FrontierMath by Ciro Santilli 37 Updated +Created
arstechnica.com/ai/2024/11/new-secret-math-benchmark-stumps-ai-models-and-phds-alike/ mentions what the official website is unable to clearly state out:
The design of FrontierMath differs from many existing AI benchmarks because the problem set remains private and unpublished to prevent data contamination
So yeah, fuck off.
The expected answer output for all problems is just one single, possibly ridiculously large, integer, which is kind of a cool approach. Similar to Project Euler in that aspect.
The most interesting aspect of this benchmark is the difficulty. Mathematical olympiad coach Evan Chen comments:[ref]
Problems in [the International Mathematical Olympiad] typically require creative insight while avoiding complex implementation and specialized knowledge [but for FrontierMath] they keep the first requirement, but outright invert the second and third requirement
facecheck.id by Ciro Santilli 37 Updated +Created
Became paid in 2024: www.reddit.com/r/OSINT/comments/1awkxbi/facecheckid_will_no_longer_be_free/ You can search, it and lists which social media websites it found the hits on, but does not give the full URLs.
Had one possible non-trivial LinkedIn hit for Ross Ulbricht's wife in early 2025, before her identity was publicly known, so they may have something actually going on there
Closed source benchmark by Ciro Santilli 37 Updated +Created
Open source benchmark by Ciro Santilli 37 Updated +Created
AI Math benchmark by Ciro Santilli 37 Updated +Created
Percolation theory by Ciro Santilli 37 Updated +Created
This field is likely both ugly and useless.
OK, in 2D they've achieved some cute rational number results. But still.
Open and closed source benchmarks by Ciro Santilli 37 Updated +Created
Percolation by Ciro Santilli 37 Updated +Created
meetup.com by Ciro Santilli 37 Updated +Created
2022 Fields Medal winner by Ciro Santilli 37 Updated +Created
2022 Fields Medal by Ciro Santilli 37 Updated +Created
Statistical mechanics model by Ciro Santilli 37 Updated +Created
Hugo Duminil-Copin by Ciro Santilli 37 Updated +Created
Person related to Ross Ulbricht by Ciro Santilli 37 Updated +Created
Wayback Machine pages don't after you just finished archiving them by Ciro Santilli 37 Updated +Created
Pages seem to take some time after they say they have "archived it" to when you can actually see what was archived.
Their system is that bad unsurprisingly.
Molecule representation by Ciro Santilli 37 Updated +Created
Temperature-composition phase diagram by Ciro Santilli 37 Updated +Created
Composition phase diagram by Ciro Santilli 37 Updated +Created
Composition phase diagrams are phase diagrams that also consider variations in composition of a mixture. The most classic of such diagrams are temperature-composition phase diagrams for binary alloys.

Unlisted articles are being shown, click here to show only listed articles.