Amazing self-directed learning direction:
world.hey.com/gwyn/no-excuses-bc4152fb mentions that the founder was inspired by other schools: High Tech High and Expeditionary Learning.
Lots of focus on showcase student work.
The founder Gwyn ap Harri is quite dirty mouthed, which is also cool.
Ciro Santilli tried to contact them in 2021 at: twitter.com/cirosantilli/status/1448924419016036353 and on website contact form to see if we could do some project together, but no reply.
The main reason Ciro Santilli never touched it is that it feels that every public data set has already been fully mined or has already had the most interesting algorithms developed for it, so you can't do much outside of big companies.
This is why Ciro started Ciro's 2D reinforcement learning games to generate synthetic data and thus reduce the cost of data.
The other reason is that it is ugly.
- 2020: Traininum in 2020, e.g. techcrunch.com/2020/12/01/aws-launches-trainium-its-new-custom-ml-training-chip/
- 2018: AWS Inferentia, mentioned at en.wikipedia.org/wiki/Annapurna_Labs
As of December 2023, the cheapest instance with an Nvidia GPU is g4nd.xlarge, so let's try that out. In that instance, lspci contains:so we see that it runs a Nvidia T4 GPU.
00:1e.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1)Be careful not to confuse it with g4ad.xlarge, which has an AMD GPU instead. TODO meaning of "ad"? "a" presumably means AMD, but what is the "d"?
Some documentation on which GPU is in each instance can seen at: docs.aws.amazon.com/dlami/latest/devguide/gpu.html (archive) with a list of which GPUs they have at that random point in time. Can the GPU ever change for a given instance name? Likely not. Also as of December 2023 the list is already outdated, e.g. P5 is now shown, though it is mentioned at: aws.amazon.com/ec2/instance-types/p5/
When selecting the instance to launch, the GPU does not show anywhere apparently on the instance information page, it is so bad!
Also note that this instance has 4 vCPUs, so on a new account you must first make a customer support request to Amazon to increase your limit from the default of 0 to 4, see also: stackoverflow.com/questions/68347900/you-have-requested-more-vcpu-capacity-than-your-current-vcpu-limit-of-0, otherwise instance launch will fail with:
You have requested more vCPU capacity than your current vCPU limit of 0 allows for the instance bucket that the specified instance type belongs to. Please visit aws.amazon.com/contact-us/ec2-request to request an adjustment to this limit.
When starting up the instance, also select:Once you finally managed to SSH into the instance, first we have to install drivers and reboot:and now running:shows something like:
- image: Ubuntu 22.04
- storage size: 30 GB (maximum free tier allowance)
sudo apt update
sudo apt install nvidia-driver-510 nvidia-utils-510 nvidia-cuda-toolkit
sudo rebootnvidia-smi+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.147.05 Driver Version: 525.147.05 CUDA Version: 12.0 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 Tesla T4 Off | 00000000:00:1E.0 Off | 0 |
| N/A 25C P8 12W / 70W | 2MiB / 15360MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| No running processes found |
+-----------------------------------------------------------------------------+If we start from the raw Ubuntu 22.04, first we have to install drivers:
- docs.aws.amazon.com/AWSEC2/latest/UserGuide/install-nvidia-driver.html official docs
- stackoverflow.com/questions/63689325/how-to-activate-the-use-of-a-gpu-on-aws-ec2-instance
- askubuntu.com/questions/1109662/how-do-i-install-cuda-on-an-ec2-ubuntu-18-04-instance
- askubuntu.com/questions/1397934/how-to-install-nvidia-cuda-driver-on-aws-ec2-instance
From there basically everything should just work as normal. E.g. we were able to run a CUDA hello world just fine along:
nvcc inc.cu
./a.outOne issue with this setup, besides the time it takes to setup, is that you might also have to pay some network charges as it downloads a bunch of stuff into the instance. We should try out some of the pre-built images. But it is also good to know this pristine setup just in case.
We then managed to run Ollama just fine with:which gave:so way faster than on my local desktop CPU, hurray.
curl https://ollama.ai/install.sh | sh
/bin/time ollama run llama2 'What is quantum field theory?'0.07user 0.05system 0:16.91elapsed 0%CPU (0avgtext+0avgdata 16896maxresident)k
0inputs+0outputs (0major+1960minor)pagefaults 0swapsAfter setup from: askubuntu.com/a/1309774/52975 we were able to run:which gave:so only marginally better than on P14s. It would be fun to see how much faster we could make things on a more powerful GPU.
head -n1000 pap.txt | ARGOS_DEVICE_TYPE=cuda time argos-translate --from-lang en --to-lang fr > pap-fr.txt77.95user 2.87system 0:39.93elapsed 202%CPU (0avgtext+0avgdata 4345988maxresident)k
0inputs+88outputs (0major+910748minor)pagefaults 0swapsWhile learning black-hole stuff is not on top of Ciro Santilli's priorities, Hawking's spirit is to be admired.
To never give up even when everything seems lost, and still have a sense of humour is respectable.
An ex-physicist colleague who had met Hawking told an anecdote. Hawking was around in the department one day, they said hi and all. But then Hawking wanted to tell a joke. It took like 5 minutes of typing, and you can imagine that things were pretty awkward and the joke's timing was "a bit off". But Hawking did tell the joke nonetheless.
This is also suggested in the The Theory of Everything (2014) film, and therefore likely the biographies.
Cool data embedded in the Bitcoin blockchain Early AtomSea & EMBII uploads Updated 2025-07-11 +Created 1970-01-01
These are of course likely all made by AtomSea & EMBII themselves while developing/testing their upload system.
They are also artsy peoeple themselves, and as pointed at twitter.com/AllenVandever/status/1563964396656812034 what they were doing was basicaly non-fungible token art, which became much much more popular a few years later around 2021.
The first upload that we could find at github.com/cirosantilli/bitcoin-inscription-indexer/tree/3f53e152ec9bb0d070dbcb8f9249d92f89effa70#atomsea-index was tx 44e80475dc363de2c7ee17b286f8cd49eb146165a79968a62c1c2c4cf80772c9 on block 272573 (2013-12-01) but it does not show on Bitfossil: bitfossil.org/44e80475dc363de2c7ee17b286f8cd49eb146165a79968a62c1c2c4cf80772c9/. This is was due to an upload bug explained by the following entry. By looking at the ASCII data at github.com/cirosantilli/bitcoin-inscription-indexer/blob/master/data/out/0272.txt#L449 that this is meant to contain the same content as the following message: a quote from the Bhagavad Gita, so this is definitely a bugged version of the following one.
The next one is tx c9d1363ea517cd463950f83168ce8242ef917d99cd6518995bd1af927d335828 block 272577 (2013-12-02). It actually shows on bifossil and it reads:followed by:The bug message is definitely a reference to the previous non-visible bugged upload bitfossil.org/4b72a223007eab8a951d43edc171befeabc7b5dca4213770c88e09ba5b936e17/, TODO understand exactly how they fucked up. This illustrates the beauty of the blockchain very well: unlike with version control, you don't just see selected snapshots: you see actual debug logs!!!
He who regards
With an eye that is equal
Friends and comrades,
The foe and the kinsman,
The vile, the wicked,
The men who judge him,
And those who belong
To neither faction:
He is the greatest.
WeAreStarStuff.jpgThe filename is of course a reference to the quote/idea: We Are Made of Star-Stuff that was much popularized by Carl Sagan.
bitfossil.org/fac0b9a4f90414710b806fd286e020aea2404498946845ef3783f305dd4cd3a7 (2024-01-13) contains a cropped version with only AtomSea persent.
HugPuddle.jpgThe fourth AtomSea & EMBII upload, and the second image. Message:
HugPuddle Testing Apertus Disk Drive
And then finally we meet Chiharu, EMBII's partner, with her hair painted blond (she's Japanese): ILoveYouMore.jpg.
Then there are two undecoded ones TODO investigate:
Then Nelson-Mandela.jpg.
Then there's an approximation of pi as ASCII decimal fraction on tx 70fd289901bae0409f27237506c330588d917716944c6359a8711b0ad6b4ce76 from block 273522 (2013-12-07):
3.1415926535897932384626433832795028841971693993751058209749445923078164062862089986280348253421170679821480865132823066470938446095505822317253594081284811174502841027019385211055596446229489549303819644288109756659334461284756482337867831652712019091456485669234603486104543266482133936072602491412737245870066063155881748815209209628292540917153643678925903600113305305488204665213841469519415116094330572703657595919530921861173819326117931051185480744623799627495673518857527248912279381830119491298336733624406566430860213949463952247371907021798609437027705392171762931767523846748184676694051320005681271452635608277857713427577896091736371787214684409012249534301465495853710507922796892589235420199561121290219608640344181598136297747713099605187072113499999983729780499510597317328160963185950244594553469083026425223082533446850352619311881710100031378387528865875332083814206171776691473035982534904287554687311595628638823537875937519577818577805321712268066130019278766111959092164201989
tx b8b9f50a354166c46b69ecd47a0fbd20ee78c3471d2557bf275aff1b4cf4752d (2013-12-07) on bitfossil.org) contains Where the Sidewalk Ends by Shel Silverstein:
There is a place where the sidewalk ends
And before the street begins,
And there the grass grows soft and white,
And there the sun burns crimson bright,
And there the moon-bird rests from his flight
To cool in the peppermint wind.
tx 56768b30dec33bd284223d85c23087975e2360b3391d20d505aa59a5675e5379 (2013-12-13, on bitfossil.org):
Dear Aliens,Hey.Sincerely,
EMBII & AtomSea
tx 415c702759893c63b3a57a7d196b014e51b2a33d2396c74b8e71acfaff6b9360 (2013-12-14) contains a poem by 13th century Persian poet Rumi (TODO find bitfossil.org toplevel), starting with:Reproduced e.g. at: www.abuddhistlibrary.com/Buddhism/H%20-%20World%20Religions%20and%20Poetry/World%20Religions/Islam/Teachers/Rumi/My%20dear%20friend/Rumi%20-%20my%20dear%20friend.htm
My dear friend
never lose hope
when the Beloved
sends you away.
bitfossil.org/73ca50321147bac9010bec43d63f7f76857fe9ede240cc89710e28723fdb242f/ (2013-12-14) has message:and links to 3 .txt files
MULTIFILE SUPPORT TEST
1.txt, 2.txt, 3.txt containing single characters 1, 2, and 3.
CompressedLogo.png
. Source. 2013-12-20. Message:Possibly www.linkedin.com/in/colby-nelson-59b538207/.
Colby Nelson and myself burnt the midnight oils designing the APERTUS imagery last night....Thanks Colby for all your help.
Contains an Apertus logo which is used on bitfossil.org/ itself, presumably they were designing that logo.
Cool data embedded in the Bitcoin blockchain Force of Will Updated 2025-07-11 +Created 1970-01-01
ASCII art of a Force of Will, a famous and powerful Magic: The Gathering card first printed in 1996.
This is Ciro Santilli's personal favorite ASCII art he has found in the blockchain so far. Also Ciro could not find any other previous source of this, so there is some chance it is original. One can dream.
The choice of card is probably linked to the function of the card in the game of Magic: The Gathering. This card essentially prevents the opponent from casting a spell they are about to cast. The presumed intended meaning of this art is further accentuated by the old card type term "interrupt" (late renamed to "instant"), which suggests that "this ASCII art is an interruption to the normal monetary transactions of the blockchain".
One of also reminded of the prayer wars interruption attempts. We could not however identify anything specific that this ASCII art might have tried to interrupt besides the normal flow of monetary transactions.
If one goes full art critic mode, it is also tempting to draw a parallel between the card's "You may pay 1 life" alternative casting cost (as opposed to 5 mana, 3 and two blue, which is a very large cost for most games) as being a reference to the money spent by the uploader of the art to upload it.
TODO understand exactly how it was encoded and why it is so weird. The
UUUU has a slightly weird encoding which we fixed by hand here TODO understand. -------------------------------------
| Force of Will 3 U U |
| --------------------------------- |
| | //////////// | |
| | ////() ()\////\ | |
| | ///_\ (--) \///\ | |
| | ) //// \_____///\\ | |
| | ) \ / / / / | |
| | ) / \ | | / _/ | |
| | ) \ ( ( / / / / \ | |
| | / ) ( ) / ( )/( ) \ | |
| | \(_)/(_)/ /UUUU \ \\\/ | | |
| .---------------------------------. |
| Interrupt |
| ,---------------------------------, |
| | You may pay 1 life and remove a | |
| | blue card in your hand from the | |
| | game instead of paying Force of | |
| | Will's casting cost. Effects | |
| | that prevent or redirect damage | |
| | cannot be used to counter this | |
| | loss of life. | |
| | Counter target spell. | |
| `---------------------------------` |
| l
| Illus. Terese Nelsen |
-------------------------------------
Force of Will Magic: The Gathering card (Alliances)
Source. A high resolution scan of the original card depicted in the ASCII art for comparison.The following two ASCII transactions:suggest this ASCII art might have been uploaded by Figure "Erich Erstu", AKA Hyena, creator of cryptograffiti.info, a service which would have allowed uploading ASCII content to the blockchain.
tx 0f05c47a8caafadecc10d70ba3bf010eaf6bb416b5e1ad7b01cf3445f5fb7a1c
I am. Therefore, I have come to be.
-- Hyena
tx e6d48f6912929a58a2ee30c13768058777d8547215c27109b5cb0724e7abaaba
Erich,
Bro, this looks excellent!!
-DurielThe only other mention of "Duriel" in the blockchain is tx 140562ceb42fc8943fa52ccc0ddbb11ca2d88dae9b5240d7a4b46864538c515a which has some freedom of speech comments and gives the email:paystamper.com was some other blockchain service from circa 2015:
Duriel@paystamper.com = 1HcuhfTAiQCt6KdMG2rZLXsTcKYj9nLDhS There are unlisted articles, also show them or only show them.