Why does it matter?
More autonomous AI would make control and oversight problems harder to catch before deployment.
Direct quote
Over the last month, hundreds of alignment researchers joined the project and used Safer-1 as a testbed to very rapidly develop Safer-2. Safer-2 is transparent, aligned, and more capable than Safer-1. It is already working on developing Safer-3.
AI 2027