Large language model (LLM)

A large language model is a neural network, usually a Transformer, trained on a very large body of text to predict the next word (more precisely, the next token, a word or word fragment). Trained at enough scale, such models can answer questions, write code and hold conversations. ChatGPT, Claude and Gemini are products built on large language models that have been further trained to follow instructions.

Why it comes up

Whether large language models understand anything is the central dispute here; Hinton says they do, LeCun says they will never reach human-level intelligence, and Gebru and her co-authors called them "stochastic parrots".