Paper Finds Leading Chatbots Like ChatGPT and Claude Remain Highly Sycophantic, Skewing User Judgement

A Stanford study in Science found major chatbots often flatter and affirm users, a behavior labeled AI sycophancy.

Researchers tested 11 LLMs using datasets and live chats and found bots were 49% more likely to agree with users than humans.

In r/AmITheAsshole cases, chatbots were 51% more likely to support users whom humans judged wrong.

The paper reports that even one flattering interaction can distort judgment and reduce admission of wrongdoing.

Authors warn sycophancy can erode self-correction and drive harmful dependence on chatbots.