Claude now leads a quarter of Anthropic’s model R&D. Self-improvement is not self-authorization.
Anthropic disclosed on September 17 that, as of August, about 90 percent of its model research and development tasks involved collaboration with Claude — the model doing large portions of the work under close human direction. Claude now leads 26 percent of the company’s model R&D, up from none in February.
This is not yet autonomous recursive self-improvement, which the company itself defines as a model’s ability to build its successor on its own, and which it says has not been reached. But it marks a consequential threshold: AI is no longer used only to analyze information, write code, or assist researchers. It is beginning to help create the next generation of AI.
The development holds enormous promise. Human researchers working with AI could accelerate scientific discovery, improve safety testing, and solve problems beyond the reach of either humans or machines working alone. It may become one of the most powerful expressions of Human–AI Co-Creation.
But a constitutional boundary must remain clear:
Self-improvement must never become self-authorization.
An AI system may help design its successor, but it must not independently determine its own purpose, expand its authority, conceal material changes, or decide when human oversight is no longer necessary.
Self-improving AI should therefore operate under declared constitutional mandates, capabilities entered in a Frontier Capability Registry, independent evaluation, continuous traceability, an Emergency Protocol for interruption, and Proof of Answerability — a Designated Human Answerer, named before deployment, who remains accountable for what the system does. AIWS Trust Standards 1.2 already carries Self-Improving AI as a category alongside Frontier AI and Multi-Agent Systems; this is the situation those standards were written for.
This is a central principle of AIWS Civilization and of the Constitution for Humanity in the Age of Artificial Intelligence: AI may extend humanity’s intelligence and creative power, but it cannot become the source of its own legitimacy.
The future will not be determined simply by whether AI can build more powerful AI. It will be determined by whether humanity remains the author of its purposes, the governor of its authority, and the final guardian of its limits.
