Generative Pre-trained Transformer (GPT)

Transformer-based language model architecture

ModelsTechnical
Updated 2 May 2025·Reviewed

Definition

A type of language model that uses transformer architecture and is pre-trained on large text corpora. GPT-4 can write essays, compose poetry, or simulate conversations.

All TermsBack to GlossaryNext TermHallucinations