California AI Regulation Bill SB 1047

By Greg Bensinger
SAN FRANCISCO (Reuters) – California legislators are set to vote on a bill as soon as this week that would broadly regulate how artificial intelligence is developed and deployed in California, despite opposition from several tech giants.

What Does the Bill Do?

Proposed by State Senator Scott Wiener, a Democrat, SB 1047 mandates safety testing for advanced AI models costing over $100 million or requiring significant computing power. Developers must also outline methods for disabling malfunctioning AI, essentially creating a kill switch.

The bill empowers the state attorney general to sue non-compliant developers, especially in cases of ongoing threats like AI compromising government systems. Additionally, it would require third-party safety audits and provide protections for whistleblowers.

What Have Lawmakers Said?

SB 1047 passed the state Senate with a 32-1 vote and was approved by the state Assembly appropriations committee. If it passes the full Assembly by August 31, it will move to Governor Gavin Newsom for possible signing by September 30.

Supporters, including Wiener, argue that legislation is crucial for public safety in the evolving AI landscape. However, some Congressional Democrats, including Nancy Pelosi, oppose it, claiming it may harm innovation and push developers away from California.

What Do Tech Leaders Say?

Tech firms, while advocating for safe AI deployment, largely oppose SB 1047. Concerns revolve around potential risks of AI evading human control. Wiener has revised the bill based on tech input, removing the proposed government oversight committee and eliminating criminal penalties, leading to some support from figures like Elon Musk.

However, companies like Alphabet and Meta have expressed concerns that the bill could deter AI development in California. OpenAI warned that the bill could threaten the growth of AI and drive talent out of the state. The uncertainty surrounding open-source AI models remains a significant point of contention.

Despite the controversy, prominent figures in technology, including Geoffrey Hinton and Yoshua Bengio, have voiced support for the bill.