Tag: AI safety
-
Instrumental convergence and power-seeking (Part 2: Benson-Tilsen and Soares)
A leading power-seeking theorem due to Benson-Tilsen and Soares does not ground the needed form of instrumental convergence
-
Papers I learned from (Part 5: Language agents reduce the risk of existential catastrophe)
Simon Goldstein and Cameron Domenico Kirk-Giannini argue that language agents reduce the risk of existential catastrophe from artificial intelligence.
-
Exaggerating the risks (Part 8: Carlsmith wrap-up)
I take a final look at the Carlsmith report on risks from power-seeking artificial intelligence, focusing on AI timelines as well as the argument from practical PS-misalignment to disempowerment of humanity.
-
Exaggerating the risks (Part 7: Carlsmith on instrumental convergence)
I take a second look at the Carlsmith report on risks from power-seeking artificial intelligence, focusing on Carlsmith’s argument for instrumental convergence.
-
Exaggerating the risks (Part 6: Introducing the Carlsmith report)
Many effective altruists believe that artificial intelligence poses a significant existential risk in this century. Let’s look at how a recent report by Joe Carlsmith makes this point.