Dario Amodei from Anthropic stated that the company has never advocated for a ban on open-weight AI models.
Dario Amodei stated that Anthropic has never called for a ban on open-weights models. He expresses support for chip export controls, measures against distillation practices, and mandatory safety testing for all sufficiently capable models, whether open or closed. On Sunday, Amodei clarified Anthropic's official stance on open-weights models, addressing concerns that the company aimed to restrict them to safeguard its interests. He noted, “Anthropic has never advocated for a ban on open-weights models. Open-weights models that lack dangerous capabilities are beneficial to the public.” His remarks followed an open letter backing open weights signed by Nvidia's Jensen Huang and several tech companies, as well as discussions among US officials regarding a ban on Chinese open-weights models.
Amodei proposed three alternatives to a ban. First, he supports enforcing chip export controls and efforts to curb the "rampant smuggling" that enables advanced chips to reach China. He highlighted that without US chips, China's ability to train models that surpass American ones is hindered by scaling laws. Second, he advocates for ending large-scale distillation activities that allow Chinese labs to create capable models at a fraction of the cost compared to starting from scratch. Third, he calls for mandatory safety testing for all sufficiently capable models, regardless of their origin, while exempting less capable models from startups and academia.
Regarding the Nvidia-supported open letter, Amodei acknowledged that open weights promote accessibility and competition but disagreed with the notion that they benefit defenders more than attackers. He used biological weapons as a pertinent example: a sufficiently advanced model could rapidly weaponize a highly contagious virus using readily available materials, while developing defenses against such threats takes significant time. Last week, TNW reported that Anthropic's lack of response to the open-weights letter was becoming notable, particularly since the company faced direct commercial harm from distillation practices. This statement serves as Anthropic's reply.
The issue of distillation carries significant commercial implications. Anthropic accused Alibaba's Qwen lab of executing the largest distillation effort against its Claude model, utilizing 25,000 fake accounts for 29 million interactions. Amodei admitted that tackling distillation is "challenging" since accounts can typically be identified only after extensive distillation has taken place. He advocated for policy intervention rather than relying on a single company's enforcement mechanisms. The stance is carefully articulated: Anthropic is not opposed to open weights but objects to the practice of developing them by infringing on its proprietary models, which were trained using smuggled chips and released without safety evaluations. The key question is whether this nuanced position will resonate with Washington's preference for simpler narratives, which the post aims to address.
Other articles
Dario Amodei from Anthropic stated that the company has never advocated for a ban on open-weight AI models.
Amodei released Anthropic's official stance regarding open weights. He is against prohibitions but advocates for export controls on chips, stricter regulations on distillation, and required safety assessments.
