New York Enacts Legislation to Avert AI-Driven Catastrophes

NY Lieutenant Governor Kathy Hochul NY Lieutenant Governor Kathy Hochul

New York lawmakers passed the RAISE Act, aiming to stop frontier AI models from OpenAI, Google, and Anthropic from causing disasters like death or over $1 billion in damages. The bill passed Thursday and targets the world’s biggest AI labs with new safety and transparency rules.

The RAISE Act requires these companies to publish detailed safety reports and report incidents involving AI misuse or theft. If they fail, New York’s attorney general can hit them with penalties up to $30 million.

The law covers AI models trained with over $100 million in compute and made available to New York residents, targeting big players from the US and China. It’s designed to avoid stifling startups or academic researchers — a key difference from California’s earlier AI bill SB 1047, which was vetoed.

Advertisement

New York Senator Andrew Gounardes, co-sponsor of the bill, said:

“The window to put in place guardrails is rapidly shrinking given how fast this technology is evolving.”
“The people that know [AI] the best say that these risks are incredibly likely […] That’s alarming.”

Anthropic’s co-founder Jack Clark noted concerns about the bill being too broad for smaller companies but hasn’t taken an official stance yet.

Jack Clark tweeted:

“Inside baseball policy thread: Last night, NY passed the RAISE act, which would establish some transparency requirements for frontier models. We @anthropicai haven’t taken a position on this bill. But I thought it’d be helpful to give some more context:”

Silicon Valley pushed back hard. Andreessen Horowitz partner Anjney Midha called the bill “stupid” in a Friday post on X, claiming it will hurt the US against competitors. Midha and Y Combinator strongly opposed California’s SB 1047 too.

Assemblymember Alex Bores, another co-sponsor, insisted the bill won’t cripple innovation or cause companies to pull out of New York, which has the third-largest US GDP.

“I don’t want to underestimate the political pettiness that might happen, but I am very confident that there is no economic reason for [AI companies] to not make their models available in New York,” Bores said.

OpenAI, Google, and Meta declined to comment. The bill now goes to Governor Kathy Hochul, who can sign, amend, or veto it.

Add a Comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Advertisement