OurBigBook
About
$
Donate
Sign in
Sign up
GPT-3
(175 B parameters, 2020-06)
Ciro Santilli
(
@cirosantilli,
37
)
...
Text-to-text model
Large language model
Generative pre-trained transformer
GPT model
List of GPT models
GPT model by OpenAI
2025-08-08
0
Like
0 By others
on same topic
0 Discussions
Create my own version
Vocabulary
size
(
V)
: 50,257
Hidden
size
(
d
_
model)
: 12,288
Context
length
2048
Q
V
size
: (
d
_head): 128
Attention heads (
h)
: 96
FFN inner
size
(
d
_ff)
4
× 12,288 = 49,152
Layers (
L)
: 96
Ancestors
(17)
GPT model by OpenAI
List of GPT models
GPT model
Generative pre-trained transformer
Large language model
Text-to-text model
AI text generation
Generative AI by modality
Generative AI
AI by capability
Artificial intelligence
Machine learning
Computer
Information technology
Area of technology
Technology
Home
Incoming links
(1)
Generative pre-trained transformer
View article source
Discussion
(0)
Subscribe (1)
New discussion
There are no discussions about this article yet.
Articles by others on the same topic
(0)
There are currently no matching articles.
See all articles in the same topic
Create my own version