We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.
Over a 1000 employees of frontier AI companies, including Dario Amodei, have issued a statement, Pacing the Frontier, that calls for the AI governance. Some of the things to note:
- It is similar to the 2023 Pause Giant AI Experiments: An Open Letter that was also signed by all sorts of important people (and some unimportant people like me. In both, the idea is that we need to go more slowly if we are to make sure that AI is safe and used for good.
- This version doesn’t ask the AI labs to “immediately pause”, but asks for the U.S. government to “support an international effort” which is an interesting shift. That international effort already exists in the form of the network of AI Safety Institutes set up after the Bletchley Summit. (I am on the Research Council of the Canadian AISI.) I also note that the statement calls for “support” not leadership. This is realistic as few countries are likely to sign up to be led by the U.S. right now. This U.S. Administration has squandered any international good will they had, at least from Canada.
- Another difference is the call for “governance tools.” This sounds a lot like the “regulation” word that normally isn’t welcome in innovation focused circles. To be fair there are other sorts of tools that can be used to govern companies and products. Many exist now, they just have to be used. The problem is that governing is something humans do. No amount of tools left on the shop floor of government are going to substitute for consistent, public, articulate governing. Who has a track record doing this? Who would trust the U.S. to support them?
- I should add that “technical and governance tools” sounds again like a techno-solutionism where you solve problems that arise from the poor governance of technology with more technology. (See Morozov’s book To Save Everything, Click Here: The Folly of Technological Solutionism.)
- Finally, I should mention that the opening to the Statement has a now tired hinge statement of the sort “AI will save us all, BUT ….” where after the hinge (the BUT) there is a little problem raised for which, of course, the authors have a solution.
AI could help create a dramatically better future, but that outcome is not guaranteed. The world’s leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.
To realize AI’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight. But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress.