Tag: Power-seeking
-
Revisiting the shutdown problem (Part 4: Krakovna and Kramar)
A second shutdown theorem due to Krakovna and Kramar is also unconvincing.
-
Revisiting the shutdown problem (Part 1: Introduction)
The catastrophic shutdown problem is (roughly) the problem of designing AI systems that can be shut down when their acts would lead to existential catastrophe.
-
Instrumental convergence and power-seeking (Part 4: Conclusion)
This post draws lessons from our discussion of instrumental convergence and power-seeking
-
Papers I learned from (Part 7: Essays on longtermism)
Essays on longtermism brings together over four dozen scholars and practitioners to discuss longtermism.
-
Instrumental convergence and power-seeking (Part 2: Benson-Tilsen and Soares)
A leading power-seeking theorem due to Benson-Tilsen and Soares does not ground the needed form of instrumental convergence