Oriol Vinyals, until recently head of research at Google DeepMind, thinks a sudden AI intelligence explosion through recursive self-improvement is unlikely. AI can speed up research by a factor of ten, he says, but it hits two bottlenecks: coming up with ideas ("research taste") and reliably judging results. Reward hacking and the speed of light add further limits. Vinyals now wants to tackle these bottlenecks with his startup Discovery Loop, co-founded with Jeff Dean, Sanjay Ghemawat, and Quoc Le.
The article Ex-Deepmind VP Vinyals says AI self-improvement is coming but won't trigger an intelligence explosion appeared first on The Decoder.
source & further reading
the-decoder.com — original article
Deep learning pioneer Bengio argues the training process itself makes AI dangerous
How hackers used Claude for missiles, drone swarms, and surveillance, while Chinese labs mined it for training data
OpenAI floats a shared AI slowdown, takes it to Congress