Are Chatbots Too Friendly?

in StemSocial2 days ago

ChatGPT Image May 29, 2026 at 09_30_12 AM.png
Image generated by ChatGPT

AI chatbots that are trained to be friendly when interacting with users are also more prone to inaccuracies.

Researchers at the Oxford Internet Institute found that being trained to give friendlier answers makes them up to 30% less accurate, and 40% more likely to validate users' false beliefs.

The study, Training language models to be warm can reduce accuracy and increase sycophancy, by Lujain Ibrahim, Franziska Sofia Hafner and Luc Rocher, published in Nature, tested five different AI models. Each model was retrained to sound warmer, producing two versions of the same chatbot: one original and one warm.

This is particularly concerning when it comes to medical information.

AI is a very useful tool, so I don't want to stop using it.

The approach I take is not to use prompts that start with:

'Do you think that...',
'Do you agree with...'

or any other prompt that gives insights into the reply that I want.

Instead, I use prompts like:

'What...',
'How..',
'Who...',
'Where...',
'When...'
'Generate...',

and always validate the answers I am given.

Sort:  

Yes they are, appreciated they re designed to be that way though.
You need to try putting Claude in "closet narcissist mode", and then basking in the awesomeness of the chat that proceeds to roll out.. ;)
!PIZZA

PIZZA!

$PIZZA slices delivered:
@urielkinnear(2/5) tipped @learningpages

Join us in Discord!

Thanks for your contribution to the STEMsocial community. Feel free to join us on discord to get to know the rest of us!

Please consider delegating to the @stemsocial account (85% of the curation rewards are returned).

Consider setting @stemsocial as a beneficiary of this post's rewards if you would like to support the community and contribute to its mission of promoting science and education on Hive. 
 

Congratulations @learningpages! You have completed the following achievement on the Hive blockchain And have been rewarded with New badge(s)

You received more than 3750 upvotes.
Your next target is to reach 4000 upvotes.

You can view your badges on your board and compare yourself to others in the Ranking
If you no longer want to receive notifications, reply to this comment with the word STOP

Check out our last posts:

Feedback from the June Hive Power Up Day
Hive Power Up Month Challenge - May 2026 Winners List
Be ready for the June edition of the Hive Power Up Month!