An open letter to Dario: if you mean it, open the weights

In a recent open letter, Dario noted that if his words hold true, he calls for the release of open weights for publicly available AI models. This request aims to slow down the progress of frontier model development without relying on regulatory measures that could lead to regulatory capture. By requiring companies to publish the weights of models they make available to the public, such as Fable and Astra, Dario believes it would create a situation where potential funding for future training runs would decrease, thus slowing progress across all labs simultaneously.

This approach avoids the bureaucratic hurdles and complications that arise when implementing new regulations. Dario, known for his principled stance and commitment to safety in AI, acknowledges the sacrifices that would be needed to implement this law. Despite facing criticism and past legal battles, he remains committed to this vision, making him uniquely positioned to propose and potentially enact such legislation.