Former OpenAI Researchers Warn Against Company’s Opposition to AI Safety Bill

Two former researchers at OpenAI have raised concerns about the company's stance against SB 1047, a proposed bill in California aimed at enforcing stringent safety measures in AI development, including the incorporation of a "kill switch."

Disappointment with OpenAI's Opposition

In a letter addressed to California Governor Gavin Newsom and other legislators, the ex-employees expressed disappointment but not surprise at OpenAI's resistance to the bill.

Lack of Trust in OpenAI's Approach

William Saunders and Daniel Kokotajlo, the researchers who penned the letter, highlighted their initial motivation for joining OpenAI – to ensure the safe evolution of the company's potent AI systems. However, they ultimately resigned due to a loss of confidence in OpenAI's commitment to developing AI responsibly and transparently.

Foreseeable Risks of Catastrophic Harm

The former employees cautioned that advancing cutting-edge AI models without sufficient safety measures could lead to significant harm to the public.

Contradictory Stance of OpenAI CEO

Saunders and Kokotajlo pointed out the inconsistency in OpenAI CEO Sam Altman's public support for AI regulation, juxtaposed with the company's opposition to actual regulatory measures such as SB 1047.

Response from OpenAI

A spokesperson for OpenAI refuted the criticism, stating that the company's position on SB 1047 had been misinterpreted. They referred to a letter from OpenAI's Chief Strategy Officer, Jason Kwon, outlining the company's concerns about the bill and advocating for federal-level regulation due to national security considerations.

Call for Immediate Action

Saunders and Kokotajlo emphasized the urgency of enacting AI regulation at the state level, as waiting for federal intervention may cause delays in safeguarding against potential risks. They urged California lawmakers to pass SB 1047 to ensure responsible AI development.

In conclusion, the former OpenAI researchers underscored the importance of regulatory measures in aligning with OpenAI's mission to construct AGI (Artificial General Intelligence) in a secure manner.

Requests for comments from Senator Scott Wiener and Governor Newsom regarding the matter remained unanswered at the time of writing.

—————————————————————————————————————————————
By: ktangalakislippert@businessinsider.com (Katherine Tangalakis-Lippert)
Title: Former OpenAI Researchers Warn Against Company’s Opposition to AI Safety Bill
Sourced From: www.businessinsider.com/openai-whistleblowers-oppose-safety-bill-sb1047-2024-8
Published Date: Sat, 24 Aug 2024 03:19:18 +0000