Tag: Shutdown problem
-
Revisiting the shutdown problem (Part 5: Implications)
Suppose that leading arguments for Catastrophic Shutdown Difficulty do not succeed. What follows?
-
Revisiting the shutdown problem (Part 4: Krakovna and Kramar)
A second shutdown theorem due to Krakovna and Kramar is also unconvincing.
-
Revisiting the shutdown problem (Part 3: Thornley)
A leading shutdown theorem due to Elliott Thornley needs strong unmentioned assumptions to ground shutdown-resistance.
-
Revisiting the shutdown problem (Part 2: Informal arguments)
Informal arguments for Catastrophic Shutdown Difficulty include the Argument from Instrumental Convergence and the Empirical Argument.
-
Revisiting the shutdown problem (Part 1: Introduction)
The catastrophic shutdown problem is (roughly) the problem of designing AI systems that can be shut down when their acts would lead to existential catastrophe.