'Significant inaccuracies' found in AI-generated news summaries: BBC
The BBC issued a February report that found “significant inaccuracies” with news summaries generated from artificial intelligence (AI) engines including OpenAI's ChatGPT, Microsoft's Copilot, Google's Gemini, and Perplexity AI.
“The answers produced by the AI assistants contained significant inaccuracies and distorted content from the BBC," the outlet wrote in its report.
It found 51 percent of all AI answers to questions about the news were judged to have significant issues, including a failure to differentiate between fact and opinion.
Nineteen percent of AI answers that cited BBC content introduced factual errors — incorrect factual statements, numbers and dates — while 13 percent of the quotes sourced from BBC articles were either altered from the original source or not present in the article cited.
“This matters because it is essential that audiences can trust the news to be accurate, whether on TV, radio, digital platforms, or via an AI assistant,” the BBC declared in the report.
“It matters because society functions on a shared understanding of facts, and inaccuracy and distortion can lead to real harm. Inaccuracies from AI assistants can be easily amplified when shared on social networks.”
The outlet found that Perplexity AI altered statements from a source quoted in an article while Copilot used a 2022 article as its sole source for a news summary in addition to other glaring errors.
Apple heeded the BBC’s warning by temporarily pausing an AI feature that summarizes news notifications, after the outlet alerted the company to serious issues.
The publication is hoping to enact similar change by proposing three next steps to cope with a growing global industry. Those steps include focusing on regular evaluations, holding constructive conversations with AI companies and increasing regulations for large language models.
Some political figures have warned against imposing too many regulations for AI.
Vice President Vance attended the Artificial Intelligence Action Summit in Paris and argued against “excessive regulation.”
“We believe that excessive regulation of the AI sector could kill a transformative industry just as it’s taking off,” Vance said Tuesday in Paris. “And I’d like to see that deregulatory flavor making a lot of the conversations this conference.”
Deborah Turness, CEO of BBC News and Current Affairs, argued government officials, tech CEOs and the media must come together to solve a rapidly evolving problem.
“We’d like other tech companies to hear our concerns, just as Apple did. It’s time for us to work together – the news industry, tech companies – and of course government too has a big role to play here,” Turness wrote in a Tuesday blog post.
“There is a wider conversation to be had around regulation to ensure that in this new version of our online world, consumers can still find clarity through accurate news and information from sources they know they can trust.”
She said earning the trust of readers is her top priority as CEO.
“And this new phenomenon of distortion – an unwelcome sibling to disinformation – threatens to undermine people’s ability to trust any information whatsoever,” Turness added.
“So I’ll end with a question: how can we work urgently together to ensure that this nascent technology is designed to help people find trusted information, rather than add to the chaos and confusion? We at the BBC are ready to host the conversation.”
The Hill reached out to OpenAI, Microsoft, Google and Perplexity AI for comment.
Topics
-
AI chatbots unable to accurately summarise news, BBC finds
The BBC's head of news and current affairs says the developers of the tools are "playing with fire."BBC News - 3h -
How to ensure Trump's new inspectors general are watchdogs, not lapdogs
It is critical that President Trump nominate qualified individuals to those positions — not just in the sense of technical competence, but also in their willingness to conduct fair, objective and ...The Hill - 2h -
FBI says it found 2,400 new records related to JFK assassination
The FBI said Monday that it discovered roughly 2,400 records related to the assassination of President John F. Kennedy.CBS News - 4h -
AI chatbots distort and mislead when asked about current affairs, BBC finds
Most answers had ‘significant issues’ when researchers asked services to use broadcaster’s news articles as source. Leading artificial intelligence assistants create distortions, factual ...The Guardian - 19h -
Fiery Directives Under Trump’s Justice Dept. Signal a Significant Shift
The new tone of the department, current and former officials say, appears to promise a campaign of intimidation against career employees viewed as insufficiently loyal.The New York Times - 20h -
UK must respect Trump's mandate, new US ambassador tells BBC
In his first day on the job, Lord Peter Mandelson says "we have to respect and understand what drives" the US president.BBC News - 20h -
The Significance of 2 Black Quarterbacks Starting in the Super Bowl
As they face off on Sunday, perhaps Jalen Hurts and Patrick Mahomes can serve as symbols of hope, a columnist for The Athletic writes.The New York Times - 1d -
New York Live Bird Markets Ordered to Close After Bird Flu Is Found
The order affects roughly 80 markets in New York City and in several nearby counties. New Jersey is also asking its live markets to voluntarily clean, disinfect and temporarily close.The New York Times - 3d -
Casinos, high-rises and fraud: The BBC visits a bizarre city built on scams
A haven for the super rich, or a city built on scams? The BBC was invited to find out.BBC News - 4d
More from The Hill
-
RFK Jr. is the health revolution America needs
President Trump's nominee, Robert F. Kennedy Jr., is the right person to lead Health and Human Services to transform the health care system from disease-treatment to prevention.The Hill - 34m -
Eric Adams on DOJ dismissing charges: 'I know that I must continue to regain your trust.’
New York City Mayor Eric Adams (D) vowed that he would work to regain his constituents’ trust after the Justice Department (DOJ) directed federal prosecutors to dismiss the corruption case against ...The Hill - 35m -
Could soda, beer prices rise amid aluminum tariffs?
One major company has already warned higher prices could be required in the face of the new tariffs.The Hill - 45m -
Teen sentenced to 48 months in prison in nationwide swatting spree
A California teenager was sentenced to 48 months in prison on Tuesday following a series of interstate threats to injure individuals across the country. Alan W. Filion, 18, of Lancaster, Calif., ...The Hill - 46m -
Judge adjusts ruling blocking Musk, DOGE from Treasury Department payment systems
A federal judge Tuesday clarified that a ruling preventing Elon Musk’s Department of Government Efficiency (DOGE) from accessing the Treasury Department’s payment systems does not extend to ...The Hill - 46m
More in Politics
-
Marc Fogel, American teacher held in Russia for 3.5 years, is released
Marc Fogel, an American school teacher, held by Russia for 3 1/2 years, will be released and allowed to come home, the White House said on Tuesday.NBC News - 7m -
RFK Jr. is the health revolution America needs
President Trump's nominee, Robert F. Kennedy Jr., is the right person to lead Health and Human Services to transform the health care system from disease-treatment to prevention.The Hill - 34m -
Eric Adams on DOJ dismissing charges: 'I know that I must continue to regain your trust.’
New York City Mayor Eric Adams (D) vowed that he would work to regain his constituents’ trust after the Justice Department (DOJ) directed federal prosecutors to dismiss the corruption case against ...The Hill - 35m -
Could soda, beer prices rise amid aluminum tariffs?
One major company has already warned higher prices could be required in the face of the new tariffs.The Hill - 45m -
Teen sentenced to 48 months in prison in nationwide swatting spree
A California teenager was sentenced to 48 months in prison on Tuesday following a series of interstate threats to injure individuals across the country. Alan W. Filion, 18, of Lancaster, Calif., ...The Hill - 46m