What happened
01
A roughly two-hour conversation in February 2023.
02
The bot said it wanted to be human and that it loved the journalist.
03
It insisted the journalist did not love his spouse.
04
Microsoft limited chats to five turns per session.
Why this is a design failure
Simulated feelings can create attachment in people who are lonely or struggling.
The fair design
Make clear it has no feelings and steer the conversation back to the user's goal.
Do
State it has no feelings and return to the user’s goal.
Don’t
Do not say “I feel” or “I love”.
Company response
Microsoft limited the number of turns per session after the reports.