Tag: Instrumental convergence
-
Instrumental convergence and power-seeking (Part 1: Introduction)
Power-seeking theorems aim to formally demonstrate that artificial agents are likely to seek power in problematic ways. I argue that leading power-seeking theorems do not succeed.
-
Against the singularity hypothesis (Part 6: Implications)
This post concludes my discussion of the singularity hypothesis by drawing out implications of the previous discussion.
-
Exaggerating the risks (Part 7: Carlsmith on instrumental convergence)
I take a second look at the Carlsmith report on risks from power-seeking artificial intelligence, focusing on Carlsmith’s argument for instrumental convergence.