Congress spent nearly a decade holding hearings on artificial intelligence while passing almost nothing to make it safer, and the New York City Council now wants to find out whether a city can do what Washington has not. On Friday, Council Speaker Julie Menin unveiled a package of bills that would require AI systems sold in the city to pass outside validation and carry a kill switch, pay whistleblowers who report violations, and let New Yorkers sue AI companies when jailbroken tools harm them. The bills will be heard on October 5 at a Committee of the Whole hearing of all 51 council members.

“We obviously are not in any way looking to stifle innovation. We want to ensure that New York stays the AI capital of the world, but with that comes responsibility,” City Council Speaker Julie Menin told Fortune. “I don’t believe these two ideas are mutually exclusive at all. In fact, I think they go hand in hand.”

“You want to be the capital of innovation, and you want to be the capital of smart, sensible regulation and guardrails around it, because you want people to have faith in the product itself.”

The council invited Dario Amodei, Sam Altman, Sundar Pichai, Elon Musk, and Mark Zuckerberg—the CEOs of Anthropic, OpenAI, Google, SpaceXAI and Meta respectively—to testify. The Oct. 5 hearing will be a Committee of the Whole, which has not happened in the City Council since 2022. Sources with knowledge of the hearing tell Fortune that none of the five requested heads are likely to testify. The City Council reserves the right to subpoena them. The companies did not immediately respond to Fortune’s requests for comment.

Still, that doesn’t rule out other leaders from representing these companies, and the aim, Menin said, is for the public to gain trust into these institutions. “These kinds of regulations actually improve people’s faith in these AI technologies.”

Cities taking the lead

For Menin, a regulatory attorney-turned-politician, the legislation isn’t meant to stay just within the city limits. “I feel strongly as a regulatory attorney, and as someone who served as commissioner of the Department of Consumer and Worker Protection, that there absolutely is a leading role for New York City to play.”

She described the bills as a case study from a course she taught at Columbia University, “When Cities Take the Lead,” which examined what cities should do “when the federal government is deregulating or failing to act.”

“This is perhaps one of the greatest cases of that, where you have a product in AI that has very little regulation,” Menin said. “In New York City we regulate all sorts of products and services, everything from barber shops to nail salons, and yet here we have a situation with AI where there is very little regulation.”

A lack of federal regulation

The federal record Menin is pushing against is long and mostly empty. The first federal AI bill, the FUTURE of AI Act, was introduced in 2017 and went nowhere. In 2023, OpenAI CEO Sam Altman asked the Senate to regulate his industry, and then-Majority Leader Chuck Schumer responded with nine closed-door forums that produced a roadmap but no bill. By 2025, Altman was telling senators that requiring government approval to release AI would be a disaster.

When Washington finally did act, it moved to stop others from acting. The Senate stripped Sen. Ted Cruz’s 10-year ban on state AI laws by a 99-1 vote in July 2025, and President Trump then created a Justice Department task force to sue states over their AI laws. Its first target, Colorado, gutted its own law five weeks after the suit was filed.

Even after Anthropic researcher Jacob Coxon resigned this month warning that AI companies were gambling with human lives, the federal response has consisted of letters and investigations. The most recent effort yet comes from a bipartisan safety bill from Cruz, Sen. Amy Klobuchar and Majority Leader John Thune, which would likely override most state laws, including New York’s current RAISE Act.

In a July post, OpenAI argued that states could fill the gap by passing laws that mirror one another, in place of a federal one. Yet it’s in New York City, rather than in most states now writing AI laws, that these companies have put down roots. Google has more than 14,000 employees in the city, and Meta leases 1.2 million square feet at 50 Hudson Yards. Anthropic leased an entire 16-story building at 330 Hudson Street this summer and expects to have more than 1,000 city employees by year’s end, while OpenAI took 90,000 square feet at the Puck Building in 2024.

“These companies have offices in New York. The product is being sold in New York, and we believe this falls into our domain to be able to regulate,” said Menin.

A slate of bills introduced at the city level

The broadest of the bills would bar any business from selling or deploying an AI system in the city unless an outside validator had checked it for data quality, bias, privacy and security under standards set by the city’s Office of Cyber Command. Every system would also need a kill switch, a human override that can shut it down.

“This is not an industry that should self-regulate,” Menin said. “Right now, the problem is that’s basically what the standard is.” A $25,000 fine applies to each instance, which Menin said means that “if there’s a swarm of agents, the penalty would apply per agent.”

A separate bill would give whistleblowers a share of the fines recovered from AI companies that break the law, which the council believes is the first in the nation. A companion measure would protect city employees and contractors who report AI threats to public safety. A third bill would let people sue AI companies for harm caused by third parties who get around safety controls, provided the harm was foreseeable and the company lacked reasonable safeguards. (Courts have not settled whether Section 230, the federal law that shields platforms from liability for users’ content, covers AI-generated output, so the bill may also test federal law).

Other bills would require city contractors to report AI safety incidents within 24 hours, bar false or misleading safety claims, set privacy rules for chatbots based on the Electronic Privacy Information Center’s People-First Chatbot Bill, and require the city to plan for AI-driven attacks on its systems. The council has said more bills are coming, including a ban on deceptive deepfakes and a study of how algorithmic tools change job duties.

“Our bills deal with all sorts of different ways that we can address the safety issue,” she said. “We want to continue that as a hub of innovation. The idea of regulation in any way hampering that, I don’t believe in.”

This story was originally featured on Fortune.com