The Info Web

#AISafety

19 entries

People (9)

  • Ajeya Cotra Berkeley-trained effective altruist who joined Open Philanthropy in 2016, led its technical AI-risk grantmaking, sat on the board of its grantee Redwood Research, and later joined METR's technical staff.
  • Amanda Askell Amanda Askell is the philosopher who leads the team shaping the character of Anthropic's Claude and is the principal author of its Constitution, an NYU-trained ethicist from the effective-altruism movement who was formerly married to its cofounder William MacAskill.
  • Buck Shlegeris AI-alignment researcher and recruiter at the Machine Intelligence Research Institute who became chief technology officer and then chief executive of Redwood Research, an Open Philanthropy-funded Berkeley nonprofit, and an Alignment Research Center director.
  • Dario Amodei Dario Amodei is the cofounder and chief executive of Anthropic, a physicist and computational neuroscientist who led GPT-2 and GPT-3 as OpenAI's vice president of research before leaving in 2020 with a group of colleagues to build a rival AI lab.
  • Ilya Sutskever Ilya Sutskever is the deep-learning researcher who co-built AlexNet under Geoffrey Hinton, cofounded OpenAI as its chief scientist, voted to remove and then reinstate Sam Altman in the November 2023 board crisis, and left in May 2024 to cofound Safe Superintelligence.
  • Jack Clark Jack Clark is the cofounder and head of policy at Anthropic, a former technology journalist who ran policy and communications at OpenAI, co-chairs Stanford's AI Index, and writes the Import AI newsletter.
  • Leopold Aschenbrenner German-born former FTX Future Fund staffer and OpenAI Superalignment researcher, fired in 2024, who founded Situational Awareness LP, an AI-infrastructure hedge fund that CNBC reported was forced to sell its public holdings in 2026.
  • Nate Thomas Stanford-affiliated machine-learning researcher who cofounded Redwood Research in 2021 as chief executive, later chaired its board, and led the affiliated Constellation Institute in Berkeley.
  • Paul Christiano OpenAI alignment lead and Open Philanthropy adviser who founded the Alignment Research Center, sat on Anthropic's trust, ran AI safety at NIST's AI Safety Institute and joined the OpenAI Foundation board in 2026.

Organizations (10)

  • 80,000 Hours Career-advice organization founded in Oxford in 2011 by Benjamin Todd and William MacAskill, hosted by the Centre for Effective Altruism's charity until 2025 and funded with at least 39.4 million dollars by Open Philanthropy.
  • Alignment Research Center AI-alignment nonprofit run by Paul Christiano, funded in 2022 by Open Philanthropy and the FTX Foundation, which incubated the evaluations team that became METR.
  • Anthropic AI company founded in 2021 by former OpenAI researchers from the effective-altruism milieu, funded early by Tallinn, Moskovitz and Bankman-Fried, deployed on classified networks, then blacklisted by the Pentagon in 2026.
  • Berkeley Existential Risk Initiative The Berkeley Existential Risk Initiative is the nonprofit founded in 2017 by Andrew Critch that provides free operational support and grants to university research groups working on existential risk, funded chiefly by Jaan Tallinn and Open Philanthropy.
  • Center for AI Policy Washington AI-safety advocacy nonprofit that registered its first lobbyist in December 2023, promoted a draft Responsible AI Act, and drew about a third of its donations from Jaan Tallinn's Lightspeed Grants.
  • Center for AI Safety San Francisco AI-safety nonprofit directed by Dan Hendrycks, funded by Open Philanthropy, which organized the 2023 extinction-risk statement; its 501(c)(4) arm co-sponsored SB 1047 and lobbied for the AI Safety Institute.
  • METR AI model evaluation nonprofit led by Beth Barnes, spun off in December 2023 from Paul Christiano's Alignment Research Center, and partner with RAND in the Canary project funded through the Audacious Project.
  • Redwood Research Berkeley AI-alignment nonprofit founded in 2021, with Open Philanthropy co-CEO Holden Karnofsky on its board until 2023, to which Open Philanthropy gave 62.52 million dollars from 2021 to 2025.
  • Safe Superintelligence Safe Superintelligence is the AI lab Ilya Sutskever cofounded in June 2024 with Daniel Gross and Daniel Levy, built to pursue a single safe-superintelligence goal with no commercial product, which raised 1 billion dollars at a 5-billion valuation and later 2 billion at a 32-billion valuation before Meta poached Gross and Sutskever became chief executive.
  • U.S. AI Safety Institute Federal AI-evaluation body created inside NIST in November 2023, renamed the Center for AI Standards and Innovation in June 2025, with Paul Christiano as its first head of AI safety.