Anthropic, OpenAI's proposed AI risk evaluators may not have enough power to prevent disasters

Anthropic and OpenAI are proposing embedded AI risk evaluators to manage the risk of models causing catastrophic harm to society, but the idea may not give those evaluators enough power to prevent disasters, according to CNBC Technology. The proposal centers on placing evaluators inside the AI labs rather than relying solely on outside oversight.

Anthropic, OpenAI's proposed AI risk evaluators may not have enough power to prevent disasters Source: CNBC Technology https://www.cnbc.com/technology/ Anthropic https://www.machinebrief.com/glossary/anthropic and OpenAI https://www.machinebrief.com/glossary/openai are proposing embedded AI evaluators to help manage risk of models causing catastrophic harm to society, but the idea has some issues. Get AI news in your inbox Daily digest of what matters in AI.