0 votes

Anthropic's Amodei calls for AI oversight, joined by Altman and Musk

1 comment

  1. skybrian
    Link
    From the article: [...] [...] [...] Amodei's essay is here.

    From the article:

    The call was first made in an essay Anthropic chief executive Dario Amodei posted online Saturday. The idea has gained ground in recent weeks as AI companies have struggled in some cases to keep their creations under control, even as they usher in an age in which AI systems themselves can build the more powerful next generation of the technology.

    [...]

    A three-step plan proposed by Amodei in his essay would involve third-party safety evaluators at “frontier” AI companies, establishing common safety standards in democratic nations, and for the United States and other democracies to work with authoritarian governments to try to ensure compliance.

    [...]

    While Amodei sketched a path to slowing progress in the name of safety, he did not commit Anthropic to cutting the pace of its own work unilaterally. He said only that for now the company would hire a team of independent evaluators who would be embedded at Anthropic’s offices and empowered to raise safety concerns.

    Amodei also provided few specifics on what a slowdown might involve in practice, describing the potential to use agreed-upon safety metrics or limits on the computer power used to train new AI systems.

    [...]

    In a post on X, Musk wrote: “Dario is right.”

    Altman said he shared Amodei’s view that groundbreaking AI companies should “pace the frontier” and said the matter had been a top discussion topic at OpenAI in recent weeks.

    “Committing to having independent evaluators with employee-like access is a great idea, and we will do the same,” Altman wrote on X.

    Amodei's essay is here.