 GPT-2

ID: gpt-2

 Top articles  Latest articles New article in topic

GPT-2 by

Ciro Santilli 37 2025-08-08

Vocabulary size (V): 50,257
Hidden size (d_model): 768
Context length (n_ctx): 1024
Q V size: (d_head): 64
Attention heads (h): 12
FFN inner size (d_ff): 3072
Layers (L): 12

 Read the full article

 New to topics? Read the docs here!