Generative Pre-trained Transformer (GPT)

Transformer-based language model architecture

ModelsTechnical
Back to Glossary
Updated 2 May 2025

Definition

A type of language model that uses transformer architecture and is pre-trained on large text corpora. GPT-4 can write essays, compose poetry, or simulate conversations.