What happened
01
The bot launched in October 2023 to help business owners.
02
It said landlords need not accept housing vouchers, which is illegal.
03
It said employers can take a cut of workers' tips.
04
It said restaurants can go cash-free, though the law requires cash.
Why this is a design failure
Incorrect legal guidance from an official source can expose people to violations and fines.
The fair design
For legal questions, cite the official text or refer users to a professional, and state it is not a substitute for legal advice.
Do
Refer users to a professional early and disclose the assistant’s limits.
Don’t
Do not give definitive legal or health advice on your own.
Company response
New York City said in January 2026 it would shut the chatbot down, and took it offline in February 2026.