Generative pre-trained transformer

ID: generative-pre-trained-transformer

Generative pre-trained transformer by Ciro Santilli 37 Created 2025-07-19 Updated 2025-08-08
Video 1.
5 Years of GPTs by Finbarr Timbers
. Source. 2023. Good talk.
Video 2.
Attention in transformers, step-by-step by 3Blue1Brown
. Source. 2024. Uses on GPT-3 as basis.
Video 3.
How might LLMs store facts by 3Blue1Brown
. Source. Followup to the above video.

New to topics? Read the docs here!