 Generative pre-trained transformer (source code)

by Ciro Santilli (@cirosantilli, 37)

= Generative pre-trained transformer
{c}
{wiki}

= GPT
{c}
{synonym}
{title2}

\Video[https://www.youtube.com/watch?v=YA0pzBYAV2Q]
{title=5 Years of GPTs by Finbarr Timbers}
{description=2023. Good talk.}

\Video[https://www.youtube.com/watch?v=eMlx5fFNoYc]
{title=Attention in transformers, step-by-step by <3Blue1Brown>}
{description=2024. Uses on <GPT-3> as basis.}

\Video[https://www.youtube.com/watch?v=9-Jl0dxWQs8]
{title=How might LLMs store facts by <3Blue1Brown>}
{description=Followup to the above video.}

 Back to article page