News

AI models just don't understand what they're talking about

The Register · Thomas Claburn · last updated

Researchers from MIT, Harvard, and the University of Chicago have proposed the term “potemkin understanding” to describe a newly identified failure mode in large language models that ace conceptual benchmarks but lack the true grasp needed to apply those concepts in practice.

It comes from accounts of fake villages – Potemkin villages – constructed at the behest of Russian military leader Grigory Potemkin to impress Empress Catherine II.

Related Knowledge Center: Artificial intelligence

State of Play

On top of a failing business model, newsrooms must navigate the powerful — and not fully reliable — new capabilities of artificial intelligence and the deployment of large language models.

State of the business model | Copyright and intellectual property


More informationabout Artificial intelligence