Implementation of AI Safety Policies
Implementation of AI Safety Policies
Of the seven policies, experts give federal preemption the best chance of implementation by 2030 at 26%, and the three-policy bundle the worst at 1%.
Hover to highlight a group, click to show or hide itTap a group to show or hide it
Forecasts by group
Median forecasts from each group
| group | 2030 | 2050 |
|---|---|---|
| Experts | 26.4% | 40% |
| Superforecasters | 20% | 40% |
| Public | 25% | 39.1% |
| AI Risk Experts | 24% | 30% |
Click any cell to compareTap any cell to compare
* Denotes non-overlapping bootstrapped confidence intervals between group aggregates.
Rationale analysis
The main lines of reasoning driving the spread in estimates
The status quo
Most respondents expect at least some substantial policies to be enacted by a jurisdiction hosting a frontier model by 2050: “The EU and China already regulate and states keep passing laws.”; “Twenty-five years without a single substantial measure in any frontier-hosting jurisdiction requires either that AI never produces a salient enough harm to force legislative attention, or that legislatures repeatedly fail to respond when it does. Under my capability assumptions the first is very unlikely, so the status-quo world is essentially the world where regulation is attempted and consistently fails to pass, a real possibility over five years, an implausible one over twenty-five.”
The minority who deem an extension of the status quo likely tend to agree that complete regulatory gridlock is unlikely, but emphasize that “LEAP has set a pretty high bar [by requiring] ‘similar or greater stringency’ compared to those listed in this survey” — and that this high bar is what makes a perpetuation of the status quo, as the survey defines it, likely.
Federal preemption
Most respondents who rank this policy as likely by 2030 do so because they perceive it to be “the only policy with genuine near-term momentum: a White House framework asserting federal authority [and] draft bipartisan legislation.” Others see preemption as forming “the bedrock of any national [policy] framework.” As one writes, “if you have something like a [pre-]authorization regime in the US, you actually would want the states not to be able to monkey around with development.” Still others point to historical precedent: “Drawing on the history of industries such as aviation and telecommunications, interstate cloud-distributed AI architectures will inevitably move toward a unified national regulatory ceiling.”
Skeptics emphasize public opposition: “Given the recent incidents (OpenAI Hugging Face, agents escaping their sandboxes during tests, etc.) it’s pretty unlikely that people would vote for a federal preemption on state AI law.”; “Polls show bipartisan opposition to federal preemption of state AI laws”; “The Senate’s 99–1 rejection of the 2025 AI moratorium demonstrates substantial resistance to surrendering state authority.”
Capability slowdown
Even after the Hugging Face incident, most respondents are skeptical that safety concerns will be enough to prompt a mandatory slowdown of the kind this policy envisions. Many note the bar is particularly high, requiring a “binding cap on compute allocated to frontier R&D, with independent verification” rather than the weaker measures they consider more likely: “A possibility is a timid capability slowdown, where compute will be capped just a little bit below the expected projections, but not as much as to meaningfully affect the actual progress of AI.”
US only. The most common barrier respondents cite is ceding advantage to China: “A compute cap materially below prevailing practice would directly cede ground in a race no participant believes they can afford to lose, so unilateral US action is implausible.” A significant minority disagree. One argues that while a “unilateral capabilities slowdown is not really in the US strategic interest…if [the] risk from RSI [recursive self-improvement] is large enough, it would enact it.” Others note the domestic constituency for slowing AI is growing, and not primarily over safety: “If the political driver is displaced workers rather than safety, then slowing development isn’t the regrettable cost of the policy — it is the point…It may well be adopted under safety framing, but the operative motive would be employment.”
US and China. Most rate this as even less likely than the unilateral version, because neither country trusts the other sufficiently and verification would be exceptionally difficult: “It would require governments to monitor private companies, something arms-control agreements have generally not done.” Some believe a joint measure is more likely precisely because reciprocity removes the competitive element: “I think it’s more likely that both countries come to an agreement than one of them do it on their own.” Many expect “a sub-catastrophic incident or near miss” could force an agreement.
Pre-release authorization
Many consider pre-release authorization more likely than a mandated slowdown, since compliance could require “relatively little sacrifice” from the developer and need not “prohibit internal development.” But that logic applies only to unilateral mandates; few respondents think China or the US will submit to a binding international authority soon.
US only. Respondents frequently note the existing system, while nominally voluntary, is close to what the policy proposes: “This already seems to be in place, at least informally, with pre-release vetting of Mythos and Astra.” One points out that “pre-release authorization gives the government sight of frontier models before anyone else, which is useful for testing its own systems, for offensive cyber capability, and for intelligence work against adversaries. That access is valuable to the state independent of any safety rationale.” Many note historical precedent: “A sufficiently capable AI system eventually being treated more like an aircraft, pharmaceutical, reactor, or other safety-critical technology does not require a particularly large conceptual leap.” Doubters focus on the mandatory component: “Mandatory affirmative authorization, including genuine power to deny deployment, is a large step beyond voluntary review.”
International. Most express deep skepticism: “The likelihood that either, much less both, would agree to subordinate a matter with such grave national security implications to an international body, is slim.”; “Nuclear non-proliferation succeeded because it rested on both broad international consensus and the substantive existence of military enforcement against defectors. Both are absent for AI-specific authorization.” Optimists note “there are precedents for supranational authorization,” in particular “the IAEA template,” and that it only “asks each side to submit releases for review rather than to slow development, which is an easier sell.”
Strict liability
Many think greater liability requirements for AI companies are likely, but distinguish that from the policy as the survey defines it: “Strict liability also seems likely a fairly conventional policy tool, although the particular regulatory regime described here in the survey is disruptive enough that I would not forecast quick adoption of such a regime.”; “The statute must cover every frontier developer, require insurance scaled to capability, and permit punitive damages without malice or recklessness based partly on catastrophic harm that never occurred. Insurability, due process, standing, attribution, political opposition, etc. are major barriers.” Skeptics also expect “tremendous opposition from the US business lobby.”
More optimistic respondents look past the stringency and see a familiar domestic tool: “This condition is common in certain domains with inherent risks, such as demolitions, hazardous chemicals, nuclear power, etc. The potential risks of AI are not exactly minor, and my guess is that eventually, as it diffuses into more and more sectors of the economy, strict liability will be standard for frontier AI models.”
The bundle
Many give the bundle low odds because all three demanding components must coexist, with one calling it “too conjunctive to be very likely. What are the chances that all three of these things will happen in that particular way?”
Several expect correlated adoption instead: “The bundle is high because one big scare drives all three policies at once.”; “A world in which one of them happens is a world in which the others are also more likely to happen.” A few dispute that, arguing governments might not want all three once one approach is established — one expects an international slowdown would probably indicate some level of nationalization had occurred, and that “we’re no longer in a standard kind of civil liability regime that strict liability would sensibly apply to.”
Rationale examples
High-quality rationales from forecasters across the range
On what drives enactment
If AI displaces workers at any significant scale, that creates a large, geographically distributed, politically activated constituency with a direct grievance. Politicians have a straightforward incentive to respond to it. And the natural form of the response is regulation — plausibly framed and marketed as safety regulation, but adopted substantially because it slows things down, which is what the affected constituency actually wants.
Binding US regulation of a dangerous technology has historically arrived within one to three years of a visible disaster (FDA 1938 and 1962, Price-Anderson 1957, Oil Pollution Act 1990).
The historical comparison that keeps occurring to me is nuclear weapons, because humanity had an unusually clear opportunity to understand the basic problem almost immediately. Nobody watched the first atomic bombs and concluded that perhaps these devices were merely an interesting productivity tool whose externalities needed further study. By the early Cold War, everyone involved understood perfectly well that an unrestricted arms race could eventually produce enough weapons to destroy civilization several times over. We responded to that insight by building an astonishing number of them anyway…That history makes me skeptical of arguments that assume recognizing a shared AI risk naturally produces cooperation. Recognition is only one variable. If both countries also believe frontier AI confers enormous military, intelligence, scientific, and economic advantage, then the individually rational decision can remain ‘continued competition’ even when both governments would prefer the jointly restrained world.
The main impetus for a pre-release authorisation in the US may come from…another jurisdiction that introduces a similar measure and it would be easiest for large frontier model firms to comply. The EU’s General Data Protection Regulation may set a precedent, despite complaints from the tech industry it became something of a global standard. There may be a similar effect here, the EU has already passed an AI act and could build upon that legislative framework with further regulation on authorisation of AI models.
Internet and AI applications do not respect state boundaries the way cars do. A single state's regulation effectively governs the entire United States, and through the concentration of frontier laboratories, the world. With the physical siting of frontier developers concentrated in one state, laws like California SB 53 are becoming de facto global standards. The historical precedent of automotive emissions is instructive. California received its special waiver in 1970 because its independent regulation was already established, and the federal government accepted the exception only reluctantly as a grandfathered vested interest. In AI, the equivalent entrenchment has not yet occurred, and the federal incentive to preempt before it does is strong.
Federal strict liability, paired with capability-scaled insurance and punitive damages including unrealized catastrophic harm, is an economically inefficient design. Requiring developers to internalize only the negative externality of catastrophic risk, while leaving the positive externalities that AI generates uncompensated (medical benefits, welfare gains, and the diffusion of productivity to developing economies), forces AI supply below the socially efficient level…The nuclear industry, by comparison, functions only because Price-Anderson pairs strict liability with a liability cap, federal indemnification above that cap, and a separate production tax credit compensating the positive externality of low-carbon electricity.