Anthropic urges AI labs to pause, warns humans risk losing control

Anthropic is proposing a coordinated pause in the development of advanced AI systems, citing the risk of humans losing control due to rapid improvements in AI technology. The company's internal research institute plans to explore this issue in collaboration with others and take actions to help build systems for a credible slowdown or pause. AI models are getting faster, with rapid increases in their ability to carry out tasks like coding on their own, and could potentially design and develop their own successors through "recursive self-improvement".