Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.This is a linkpost for https://carado.moe/ldt-reduce-arms-race.html

(Epistemic status: I think this is right?)

Alice is the CEO of ArmaggAI, and Bob is the CEO of BigModelsAI, two major AI capabilities organizations. They're racing to be the first to build a superintelligence aligned to their respective CEV which would take over the universe and satisfy their values.

Alice would prefer to slow down so she has a lot more time to make sure that what her company is building will be aligned; but she's worried about Bob's company taking advantage of that and racing themselves, resulting in Bob's utility function being {what the lightcone is filled with} instead of Alice's; so she feels like she has no choice but to race, to maximize her own utility. Likewise vice-versa.

This state of affairs is far from the [...]

---

First published:
December 10th, 2023

Source:
https://www.lesswrong.com/posts/yRdXtgy8CZtg2YtAY/how-ldt-helps-reduce-the-ai-arms-race

Linkpost URL:
https://carado.moe/ldt-reduce-arms-race.html

---

Narrated by TYPE III AUDIO.

[Linkpost] “How LDT helps reduce the AI arms race” by Tamsin Leake

LessWrong (30+ Karma)