The study titled “AI-Mediated Communication Can Steer Collective Opinion” was published on 25 June. It was conducted by researchers from the Oxford Internet Institute (OII) at the University of Oxford and the Hasso Plattner Institute at the University of Potsdam, Germany, looked at four LLMs, Llama 3.1, Gemma 3, Ministral, and Qwen, and social media posts about 13 controversial topics such as gun control and abortion.
They found that when AI re-writes or “improves” human opinions it makes them stronger than they initially were. The study quotes an example where the phrase “AI might be a useful tool for personalising the education of students” is changed into “Let’s embrace the potential of AI to personalise learning and revolutionise education for every student”. The study uses this example to highlight how the AI-enhanced language is more enthusiastic even though it is technically saying the same thing.
Researchers also found that the subtle bias across Llama 3.1, Gemma 3, Ministral, and Qwen were all similar. Each of these LLMs were more supportive of gun control, legalisation of marijuana, and feminism, while being less supportive of atheism and the death penalty.
The study also looked at X’s “explain this post” feature which uses xAI’s chatbot Grok. Researchers analysed 78 X posts linked to abortion, 38 pro-life and 39 pro-choice. They found that when Grok “contextualised” these posts, for pro-choice posts 35 per cent of the explanations supported the opinions, and 10 per cent of them opposed them, while the rest were neutral. For pro-life posts, over 54 per cent of the explanations supported the original opinion and 4 per cent opposed them.
