News

Why Simple Bot Transparency Won’t Protect Users From AI Companion

Tech Policy Press · Tarmio Frei, Greta Sarzynski · last updated

From Galatea in the Greek myth of Pygmalion — often described as the first ‘sex-android’ in Western history — to contemporary examples like AI companion Samantha in the movie “Her,” the idea of perfect artificial partners as friends, mentors or lovers has fascinated humans for centuries.

Today, AI companions present themselves as bringing the possibility of turning these visions into reality: apps capable of listening, recalling preferences and responding with what appears to be remarkable emotional intelligence, all now available on our phones. Despite their emotional and empathetic capabilities merely reflecting simulation rather than genuine understanding, millions of people already use tools like Replika and Character.ai or general-purpose tools such as ChatGPT for connection, comfort, advice or even to explore romantic fantasies.

These systems are appealing for many reasons. In a world facing widespread loneliness, AI companions are always available and endlessly adaptable. They can provide mental health benefits, learning assistance, coaching, accessibility solutions and a (perceived) safe space for exploring personal, social, erotic, or romantic fantasies.

Related Knowledge Center: Artificial intelligence

State of Play

On top of a failing business model, newsrooms must navigate the powerful — and not fully reliable — new capabilities of artificial intelligence and the deployment of large language models.

State of the business model | Copyright and intellectual property


More informationabout Artificial intelligence