Research
Press
BBC NewsThe friendlier the AI chatbot the more inaccurate it is, study suggests
New study led by Lujain and Sofia finds that friendlier chatbots make more mistakes.
MashableStudy: Friendly AI chatbots may be less accurate
How does a friendlier chatbot respond to a falsehood about the moon landings?
NatureFriendlier LLMs tell users what they want to hear - even when it is wrong
A large language model that is trained to respond in a warm manner is more likely to give incorrect information and reinforce conspiracy beliefs.
The TelegraphWhy you don’t want your AI chatbot to be nice to you
Systems trained to sound friendlier are up to 30 per cent less accurate, study finds
The GuardianFriendly AI chatbots more likely to support conspiracy theories, study finds
Chatbots programmed to respond warmly even cast doubts on Apollo moon landings and fate of Hitler, researchers say.
The VergeFriendly chatbots make more mistakes
The researchers found AI chatbots trained to be warmer were significantly more likely to make factual errors and agree with false beliefs than the originals.
de CorrespondentThe claims about increasingly smart AI models?
More vibe than science. Luc comments.
NBC NewsAI Revolution – NBC News discuss latest OII study exploring AI evaluation
The NBC Morning News programme discuss the findings from Andrew's latest study which finds weaknesses in how AI systems are evaluated.
The RegisterAI benchmarks are a bad joke - and LLM makers are the ones laughing
Covers our research finding that many AI benchmarks do not measure the right things.
GizmodoAI Capabilities May Be Overhyped on Bogus Benchmarks, Study Finds
Covers our Measuring What Matters study on the construct validity of AI benchmarks.
NBC NewsAI’s capabilities may be exaggerated by flawed tests, according to new study
Researchers behind a new study say that the methods used to evaluate AI systems’ capabilities routinely oversell AI performance and lack scientific rigour.
The GuardianExperts find flaws in hundreds of tests that check AI safety and effectiveness
Scientists say almost all have weaknesses in at least one area that can ‘undermine validity of resulting claims’ with commentary and latest research findings from Andrew.
The Daily TelegraphChatGPT is driving people mad
In a recent research paper, academics at the Oxford Internet Institute found that AI systems producing “warmer” answers were also more receptive to conspiracy theories.
Oxford Internet InstituteDo language models have an issue with gender?
Feature piece by Sofia about our study on how to best evaluate if language models perpetuate gender stereotypes.