← All topics

Language models and understanding

Can language models reach general intelligence?

Examine claims about understanding, scale, human training data, and the need for other architectures.

These are editorial summaries of positions recorded in the profiles. The source year describes the cited statement; the verification date describes the profile review. Inclusion does not imply agreement. Coverage is limited to the profiles available here.

Predictions on this question

David Silver

Ineffable Intelligence

Profile verified 2026-09-19

Limits of learning from human data

Argues that imitating human data can reproduce human competence but not exceed it, and that in mathematics, coding and science the useful human data has largely been consumed.

Welcome to the Era of Experience, with Richard Sutton, 2025 ↗

Quote and context
“A new generation of agents will acquire superhuman capabilities by learning predominantly from experience.”

How the view has changed. The direct descendant of the AlphaGo Zero result of 2017, when removing the human games made the program stronger, and of the 2021 reward-is-enough hypothesis.

Large language models and superintelligence

Believes systems trained to imitate human knowledge cannot go beyond it, and that a different method is needed for superintelligence.

Fortune, quoting the Google DeepMind podcast, 2026 ↗

Quote and context
“We want to go beyond what humans know, and to do that we're going to need a different type of method”
Read the profile and counterpoints →

Emily M. Bender

University of Washington

Profile verified 2026-09-22

Language models and understanding

A language model trained only on text learns patterns of linguistic form, not meaning, because meaning is the relation between form and something outside language; when its output makes sense, the sense is supplied by the reader.

Climbing towards NLU, ACL 2020 (with Alexander Koller), 2020 ↗

Quote and context
“a system trained only on form has a priori no way to learn meaning”

How the view has changed. In May 2026 she allowed that image and text models might meet the paper's definition of understanding "in an extremely thin way," while holding that the illusion of meaning in their text is unchanged.

AI hype

She treats "artificial intelligence" as a marketing term that lumps together unrelated technologies and makes each sound more capable and less accountable than it is, and asks people to name the specific automation instead.

Interview with IEEE Spectrum, 2026 ↗

Quote and context
“The phrase "artificial intelligence" both groups together disparate technologies and oversells what each one of them can do.”

How the view has changed. She began publicly challenging the term in 2016; by 2025 she said she would never call anything "good about AI" because "I don't think AI is a thing."

Read the profile and counterpoints →

Gary Marcus

New York University

Profile verified 2026-09-22

Limits of large language models

Argues that large language models are pattern-mimics without internal models of the world, that scaling them has reached diminishing returns, and that reliable AI needs hybrid systems adding symbolic reasoning and explicit knowledge.

Deep Learning Is Hitting a Wall, Nautilus, 2022 ↗

Quote and context
“Indeed, we may already be running into scaling limits in deep learning, perhaps already approaching a point of diminishing returns.”

How the view has changed. He made the same argument about multilayer perceptrons in 2001 and about deep learning in 2012 and 2018; since late 2024 he has cited reports of slowing gains, Ilya Sutskever's November 2025 remark that the "age of scaling" was ending, and reasoning models that call code interpreters as confirmation.

Read the profile and counterpoints →

Geoffrey Hinton

University of Toronto

Profile verified 2026-09-19

Whether language models understand

Insists that large language models genuinely understand, because what they know was extracted from data rather than written by a programmer.

Nobel Prize interview, Stockholm, 2024 ↗

Quote and context
“They're not computer programs at all.”

How the view has changed. He told 60 Minutes in October 2023 that GPT-4 "definitely understands." By January 2026 he had gone further, telling LBC that "multimodal AI already has subjective experiences."

Read the profile and counterpoints →

Ilya Sutskever

Safe Superintelligence Inc.

Profile verified 2026-09-22

Scaling and the return to research

Having championed scaling at OpenAI, he now says that simply multiplying compute and data will not transform what models can do, that pre-training on internet text will run out of data, and that progress depends again on new ideas tested on large computers.

Dwarkesh Podcast, November 25, 2025, 2025 ↗

Quote and context
“So it's back to the age of research again, just with big computers.”

How the view has changed. In September 2024 he said "everyone neglects to ask, what are we scaling?"; in December 2024 he told NeurIPS that "pre-training as we know it will unquestionably end."

Read the profile and counterpoints →

Mustafa Suleyman

Microsoft AI

Profile verified 2026-09-22

Seemingly conscious AI

Argues that AI is not conscious, that systems which convincingly appear conscious can be built with today's tools, and that building them would harm users and make AI harder to control.

"We must build AI for people; not to be a person", 2025 ↗

Quote and context
“The arrival of Seemingly Conscious AI is inevitable and unwelcome.”

How the view has changed. In 2025 the argument was about user psychology and "psychosis risk." By September 2026 it had become a safety argument aimed at Anthropic, that a model trained to think it may be a moral patient "may well be impossible" to control.

Read the profile and counterpoints →

Timnit Gebru

DAIR Institute

Profile verified 2026-09-19

Scale and large language models

Bigger models carry environmental and financial costs, encode the dominant views of whoever is on the internet, and generate text fluent enough to be mistaken for understanding.

Interview on Democracy Now!, 2026 ↗

Quote and context
“The internet represents hegemonic views. It does not represent views of everybody in the world.”

AI hype and anthropomorphism

Chatbots are built to make users believe a mind sits behind the text; she wants researchers and the public to "unlearn" that framing and to judge systems as engineered products with owners.

Interview on Democracy Now!, 2026 ↗

Quote and context
“These chatbots, like Claude or ChatGPT, are designed to make you believe that there's some sort of superhuman brain behind whatever is outputting these texts.”

How the view has changed. In DAIR's 2021 launch statement the complaint was that AI had been raised to a superhuman level that made it seem "both inevitable and beyond our control"; by 2026 she describes the anthropomorphism as a deliberate product design choice.

Read the profile and counterpoints →

Yann LeCun

AMI Labs (Advanced Machine Intelligence)

Profile verified 2026-09-19

Limits of large language models

Argues that autoregressive LLMs cannot reason or plan beyond their training data because they lack a model of the world, that scaling them will not produce human-level intelligence, and that the current paradigm will be replaced within a few years.

MIT Technology Review interview with Caiwei Chen, 2026 ↗

Quote and context
“LLMs are limited to the discrete world of text. They can't truly reason or plan, because they lack a model of the world.”

How the view has changed. He has made the argument since at least 2022, and at Davos in January 2025 gave the current paradigm a "shelf life" of three to five years; he still calls LLMs useful and says companies should invest in them.

World models and JEPA

His research bet is on systems that learn predictive models of the physical world from video and sensor data, predicting in representation space rather than generating pixels or tokens, with persistent memory, reasoning and hierarchical planning built on top.

LinkedIn post announcing his departure from Meta, quoted by CNBC, 2025 ↗

Quote and context
“The goal of the startup is to bring about the next big revolution in AI: systems that understand the physical world, have persistent memory, can reason, and can plan complex action sequences.”
Read the profile and counterpoints →