New York City AI Regulation Bills Put Audits and Shutdowns on the Table
fortune.com

New York City AI Regulation Bills Put Audits and Shutdowns on the Table

Tech News
4 min read

Published by AINave Editorial • Reviewed by Ramit

TL;DRNew York City has proposed a package of AI bills that would require independent checks and human-operated shutdown controls, alongside reporting and worker protections. They are proposals, not current law, and the broadest measure’s scope could reach any business selling or deploying covered systems in the city.

New York City’s proposed AI regulation bills reach beyond city agencies: the broadest measure would bar businesses from selling or deploying an AI system in the city unless it passed an outside review and had a human-operated shutdown control. City Council Speaker Julie Menin unveiled the package ahead of an October 5 hearing involving all 51 council members; none of the five invited AI-company CEOs was expected to testify at the time of publication, according to Fortune’s reporting. These measures are proposals, not enacted rules. Fortune reported the package and hearing plans.

Independent checks and a kill switch

The broadest bill would require an outside validator to assess data quality, bias, privacy and security against standards set by the city’s Office of Cyber Command. Each covered system would also need a “kill switch,” described as a human override that can shut it down. The proposal sets a $25,000 fine for each instance, which Menin said could mean a separate penalty for each agent in a swarm. Those requirements and the proposed fine put operational control alongside assessment: the system would have to be reviewed, and someone would need a way to stop it.

That combination is more specific than a general call for responsible AI. But the reporting does not spell out how the city would define an “instance,” or how an outside validator would conduct reviews in practice. Those details could matter to companies deploying multiple systems or agents, especially if the per-instance interpretation becomes part of the bill’s final form.

Reporting and recourse extend beyond audits

Other proposals would give whistleblowers a share of fines recovered from companies that violate the law, while a companion measure would protect city employees and contractors who report AI threats to public safety. City contractors would have to report AI safety incidents within 24 hours, and another bill would bar false or misleading safety claims. Fortune’s account describes these proposed protections and obligations.

A separate proposal would let people sue AI companies for harm caused when third parties bypass safety controls, but only when the harm was foreseeable and the company lacked reasonable safeguards. The legal footing is uncertain: courts have not settled whether Section 230, which shields platforms from liability for users’ content, applies to AI-generated output. That unresolved question could shape how this route to recourse works. The proposal and the reported Section 230 uncertainty.

Chatbot privacy and city readiness

The package would also set chatbot privacy rules based on the Electronic Privacy Information Center’s People-First Chatbot Bill, and require the city to plan for AI-driven attacks on its systems. The council said additional bills were coming, including a proposed deceptive-deepfake ban and a study of how algorithmic tools change job duties. These measures are part of the announced package, not established city requirements.

Menin has framed the effort as compatible with New York’s ambition to be an AI hub. The sharper test is whether a city can turn broad requirements like outside validation and a per-instance fine into workable standards. The October 5 hearing is an early step in that process, not the end of it. The hearing is scheduled as a Committee of the Whole.

FAQs

The proposed package includes outside validation and shutdown controls, whistleblower and worker protections, 24-hour incident reporting by city contractors, chatbot privacy rules and city planning for AI-driven attacks. The bills were scheduled for an October 5 council hearing and are not current law. Fortune’s account outlines the proposals and hearing.

Sources

Latest Tech News