New York City Justifies Support for AI Chatbot Encouraging Entrepreneurs to Violate Laws
In a bold move, New York City Mayor Eric Adams is standing by the city’s new artificial intelligence (AI) chatbot, despite recent controversies surrounding its accuracy. The chatbot, known as MyCity, has been caught giving business owners incorrect advice that would potentially lead them to break the law. However, Mayor Adams insists that the chatbot is still in its pilot phase and believes that any technological innovation requires time to work out the kinks.
When MyCity was initially launched as a pilot program in October, it was hailed as a groundbreaking use of AI technology. The aim was to provide business owners with reliable and actionable information in response to their queries through an online portal. Unfortunately, journalists at The Markup recently discovered that the chatbot was often providing inaccurate answers.
Some of the erroneous advice given by MyCity included suggesting that employers could take a portion of their workers’ tips and claiming that there were no regulations requiring bosses to notify employees of schedule changes. These inaccuracies have raised concerns among business owners who rely on the chatbot for guidance.
Despite the flaws, Mayor Adams has remained a staunch supporter of using untested technology in the city. He previously introduced a 400-pound robot in Times Square subway station to help deter crime, but it was retired after five months due to its ineffectiveness. The mayor’s optimism for technological advancements appears to be unwavering, even in the face of criticism.
As of now, the MyCity chatbot remains online and continues to provide incorrect answers to some inquiries. For instance, it wrongly claims that store owners are free to go cashless, disregarding a 2020 law banning stores from refusing cash payments. The chatbot also fails to update its knowledge of the city’s minimum wage, still stating it as $15 per hour instead of the recently increased rate of $16.
The issues plaguing MyCity can be attributed to the challenges commonly faced by generative AI technology platforms like ChatGPT. These platforms have a tendency to fabricate information or assert falsehoods with unwavering confidence. Microsoft, whose Azure AI service powers the chatbot, is working with the city to address and resolve these problems. However, the exact cause of the errors and how they will be fixed remain undisclosed.
To mitigate potential legal consequences, the city’s Office of Technology and Innovation plans to update disclaimers on the MyCity chatbot website. The disclaimers will explicitly state that the chatbot’s responses may be inaccurate or incomplete and advise businesses not to rely on them as legal or professional advice. This precautionary measure aims to protect business owners from following misguided guidance that could lead to serious legal ramifications.
Andrew Rigie, director of the NYC Hospitality Alliance, commends the city for its use of AI to support businesses but emphasizes the need for accuracy. Rigie warns that relying on the chatbot’s advice without confirmation from legal professionals defeats its purpose. Business owners should exercise caution and consult with their lawyers before making any decisions based on the chatbot’s responses.
While the MyCity chatbot has faced criticism for its inaccuracies, Mayor Adams remains hopeful that it will improve with time. As New York City continues to explore innovative solutions through technology, it is crucial to ensure that these advancements deliver reliable and trustworthy information to support the city’s entrepreneurs.
