Prototype: github.com/cirosantilli/Urho3D-cheat
Top Down 2D Continuous Game with Urho3D C++ SDL and Box2D for Reinforcement learning by Ciro Santilli (2018)
Source. Source code at: github.com/cirosantilli/Urho3D-cheat.Screenshot of the basketball stage of Ciro's 2D continuous game
. Source code at: github.com/cirosantilli/rl-game-2d-grid. Big kudos to game-icons.net for the sprites.Less good discrete prototype: github.com/cirosantilli/rl-game-2d-grid YouTube demo: Video 1. "Top Down 2D Continuous Game with Urho3D C++ SDL and Box2D for Reinforcement learning by Ciro Santilli (2018)".
Top Down 2D Discrete Tile Based Game with C++ SDL and Boost R-Tree for Reinforcement Learning by Ciro Santilli (2017)
Source. The goal of this project is to reach artificial general intelligence.
A few initiatives have created reasonable sets of robotics-like games for the purposes of AI development, most notably: OpenAI and DeepMind.
However, all projects so far have only created sets of unrelated games, or worse: focused on closed games designed for humans!
What is really needed is to create a single cohesive game world, designed specifically for this purpose, and with a very large number of game mechanics.
Notably, by "game mechanic" is meant "a magic aspect of the game world, which cannot be explained by object's location and inertia alone" in order to test the the missing link between continuous and discrete AI.
The question then becomes: do we have enough computational power to simulation a game worlds that is analogous enough to the real world, so that our AI algorithms will also apply to the real world?
To reduce computation requirements, it is better to focus on a 2D world at first. Such world with the right mechanics can break any AI, while still being faster to simulate than a 3D world.
The initial prototype uses the Urho3D open source game engine, and that is a reasonable project, but a raw Simple DirectMedia Layer + Box2D + OpenGL solution from scratch would be faster to develop for this use case, since Urho3D has a lot of human-gaming features that are not needed, and because 2019 Urho3D lead developers disagree with the China censored keyword attack.
Simulations such as these can be viewed as a form of synthetic data generation procedure, where the goal is to use computer worlds to reduce the costs of experiments and to improve reproducibility.
Ciro has always had a feeling that AI research in the 2020's is too unambitious. How many teams are actually aiming for AGI? When he then read Superintelligence by Nick Bostrom (2014) it said the same. AGI research has become a taboo in the early 21st century.
Related projects:
- github.com/deepmind/lab2d: 2D gridworld games, C++ with Lua bindings
Related ideas:
- www.youtube.com/watch?v=MHFrhIAj0ME?t=4183 Can't get you out of my head by Adam Curtis (2021) Part 1: Bloodshed on Wolf Mountain :)
- www.youtube.com/watch?v=EUjc1WuyPT8 AI alignment: Why It's Hard, and Where to Start by Eliezer Yudkowsky (2016)
Bibliograpy:
- agents.inf.ed.ac.uk/blog/multiagent-learning-environments/ Multi-Agent Learning Environments (2021) by Lukas Schäfer from the Autonomous agents research group of the University of Edinburgh. One of their games actually uses apples as visual represntation of rewards, exactly like Ciro's game. So funny. They also have a 2d continuous game: agents.inf.ed.ac.uk/blog/multiagent-learning-environments/#mpe
- humanoid robot simulation
- Section "AI training game"
- Section "Software-based artificial life"
OpenAI Plays Hide and Seek... and Breaks The Game! by Two Minute Papers (2019)
Source. Commentary of OpenAi's 2019 hide and seek paper. OpenAI does some similar simulations to what Ciro wants, but TODO do they publish source code for all of them? If not Ciro calls bullshit on non-reproducible research, and even worse due to the fake "Open" in the name. Does this repo contain everything?Much bigger simulation, AIs learn Phalanx by Pezzza's Work (2022)
Source. 2d agents with vision. Simple prey/predator scenario.The main ones as of 2020 are:
- Mentor Graphics, which was bought by Siemens in 2017
- Cadence Design Systems
- Synopsys
Maybe Ciro Santilli should do something useful and remarkable so that someone might actually want to read his biography in the first place. But hey, procrastination.
Ciro Santilli was born in Brazil in the small/medium city of Rio Claro, São Paulo (~200k people in 2020) in the State of São Paulo in 1989 AD.
The family then moved to Jundiaí in 1995, and then finally to Santos, São Paulo, Brazil in 1997.
At the age of 10, Ciro Santilli spent 10 months in Coventry, United Kingdom, where he greatly improved his English.
After Coventry, Ciro's family went back to Santos, São Paulo, Brazil, which made a deep impression on Ciro, until he Ciro Santilli's undergrad studies at the University of São Paulo in 2007.
In 2010, as mentioned at Section "Ciro Santilli's formal education", Ciro as admitted in a double degree program at the École Polytechnique, France, where he stayed until 2013. Going to France was a mind blowing, life changing event.
Ciro Santilli never did any illegal drugs, because he:so don't expect any amazing stories here.
- doesn't want to help fund organized crime. Notably, Ciro is for complete legalization of drugs of all drugs
- already has better more sustainable drugs like love, cycling, learning the natural sciences and fame. He (or more realistically, the world) chose life for him.
Like LDS believers, Ciro never drinks coffee nor smokes, and only drinks alcohol and tea sparingly, because they are all addictive drugs and bring no net increase of energy and concentration.
Ciro prefers to only enjoy a glass of tea when going out cycling on a cold day (Earl gray, with milk, no sugar), or get a half pint of beer when going out with friends to a pub.
Ciro only got reasonably drunk twice on his life:
- once when he was quite young, likely pre-10 years old, while visiting an uncle's home, and adults were having a very nice sweet and thick type of alcoholic cocktail, and Ciro drank a bit too much and that made him really really stupid
- once while studying at University of São Paulo, somehow someone was giving free beers at one of the parties (at which Ciro practiced Cirodance). And since Ciro had always been a cheap-ass, he thought, hey, this is a good chance to try it out. Ciro remembers that this made him a bit euphoric, active, very stupid, and a bit horny (though of course, he got no pussy as usual).
Later in life, around the time of his wedding, there were guests around all the time, and he was drinking beer with them all the time. Then one day, during lunch, Ciro felt a weirdly strong desire to drink one more pint. It was at this point that Ciro realized first-hand what mild, but real, alcohol addiction felt like, and he didn't get that drink, and swore from then on to never drink more than one glass a week, and only with friends at a bar after work. Richard Feynman tells a very similar story on his book Surely You're Joking, Mr. Feynman chapter O Americano, Outra Vez!, see: Section "Richard Feynman's drug use".
Are particles bounced by the first wall in the double slit experiment? Updated 2025-06-17 +Created 1970-01-01
It would be amazing to answer this with single particle double slit experiment measurements!
The general result from eigendecomposition of a matrix:becomes:where is an orthogonal matrix, and therefore has .
There are unlisted articles, also show them or only show them.