Never too late' to block AI bots: who's doing it and who's not?
🚫 The advice at an online publishing event in London this week was that it’s “never too late to block” AI bots from scraping websites without providing payment in exchange.
Most have got this message by now: new data shared with us by Buzzstream shows eight in ten of the biggest publishers in the US and UK are now blocking at least one of the main AI training crawlers while seven in ten are blocking live retrieval bots.
We’ve got a full breakdown of who’s blocking what — and a reminder of why it matters.
But there’s also a warning that typos and misconfigurations may mean publishers think they are blocking the bots but are doing so ineffectively.
And, of course, we know that robots.txt isn’t totally reliable, in part because third-party content scrapers can circumvent it to provide content for AI companies regardless of them being unwanted.
👩💻 Vox has always done things a bit differently, putting focus on explainers early.
Now it’s going big on creator platform Patreon, making it a focus of its existing memberships offering. It’s walking the walk where other publishers are talking the talk on building a closer relationship with their audience.
I spoke to Vox editor-in-chief and publisher Swati Sharma and head of consumer revenue Priyanka Arya about why they decided to be “the first national newsroom to use Patreon at scale” (they believe).
💲This week I also looked at new estimates suggesting global news media revenue was steady in 2025 on $125.7bn. It was sobering to compare this to the revenue of online publishing giants Google and Meta.
The WAN-IFRA research also indicated publishers are continuing to diversify beyond print and digital, with events, B2B services and platform partnerships all mentioned as growth areas.
And after Press Gazette counted more than 3,000 job cuts in the US and UK in 2025, it was interesting to learn that volatility was higher in developed markets last year with “both the largest staffing increases and the steepest declines”.
⚖️And we have the final tally of publishers that sued Google over “deceptive and manipulative” adtech practices last week was five: Penske Media, The Atlantic, McClatchy, Conde Nast and Vox Media.
The publishers are arguing Google deprived them of revenue for many years by forcing them into its ecosystem where it could see rivals’ bids through its ad exchange before submitting its own, allowing it to keep prices low.
Meanwhile Google attempted to dismiss Penske’s separate case against it over content appearing in AI Overviews.
The tech giant said it is “not obligated” to include any publisher’s content in search results and that it is “free to set the terms on which it will engage with” them.
🧑⚖️ Read all our coverage of the gripping courtroom showdown between Prince Harry and the Daily Mail here (including Harry and Liz Hurley taking the stand).
The Wall Street Journal also announced a restructure that will involve the departure of some staff.
Prince Harry did not complain about articles ‘because of the institution I was in’.
Social-first publisher deal brings cost of Future acqusitions to £1.6bn over ten years.
Staff will transfer on 1 March with option to take redundancy.
Newspapers criticised climate change policies but did not deny its existence.
Sir Elton John and David Furnish (left) and Prince Harry (right) arrive at the High Court in London on Monday 27 March 2023 for a hearing in their unlawful information gathering action against Mail publisher Associated Newspapers. Pictures: Dan Kitwood/Getty Images and PA Wire/Jordan Pettitt
Prince Harry is facing the publisher of the Daily Mail in what is set to be one of Britain’s biggest ever privacy trials.
Costs for both sides could top £40m.
Harry has accused the Mail of commissioning burglary, phone tapping and voicemail interception. The Mail denies everything and accuses Prince Harry’s legal team of using cash payments to witnesses to bolster their case.
Dominic Ponsford looks back to the News of the World front page in 2008 which started the war on UK tabloids which has raged on since then.
He also discusses the questionable evidence-gathering tactics which the Daily Mail believes undermine Prince Harry’s case and explains why the backing of co-claimant Sir Elton John means this final legal battle is set to go the distance.
Related Knowledge Center: Artificial intelligence
On top of a failing business model, newsrooms must navigate the powerful — and not fully reliable — new capabilities of artificial intelligence and the deployment of large language models.
State of the business model | Copyright and intellectual property
Related Knowledge Center: State of the business model
The traditional journalism business model has long since collapsed, and news organizations have shrunk or disappeared entirely. While a number of promising experiments are under way, the public has not shown a willingness to buy what news organizations are selling.