NYC's AI Chatbot Misleads on Legal Advice, Raising Concerns

The city's AI tool for business and landlord guidance under fire for providing incorrect information, prompting calls for immediate action.

New York City's AI-powered chatbot, designed to assist businesses and landlords with legal advice, has been disseminating incorrect and potentially illegal information.
The chatbot has been found to inaccurately advise on matters such as housing policy, worker rights, and business regulations, leading to concerns over liability and misinformation.
Despite being a pilot program, the chatbot's errors have sparked criticism from legal experts, advocacy groups, and business owners, urging immediate corrections or discontinuation.
The city's Office of Technology and Innovation defends the chatbot as a work in progress, promising improvements while acknowledging the tool's current limitations.
The incident raises broader questions about the reliability and ethical implications of deploying AI technologies in sensitive areas like legal advice and government services.