This critical review examines Eliezer Yudkowsky and Nate Soares’s If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All, focusing on its treatment of artificial intelligence risk, evidentiary certainty, precautionary regulation, and global governance. The book presents a compelling warning that superhuman AI developed through current machine-learning approaches could create irreversible and potentially existential harm. Its principal strengths lie in making complex alignment challenges accessible, distinguishing interpretability from control, and placing the burden of demonstrating safety on developers of high-risk systems. However, this review argues that the book’s claim of near-certain human extinction exceeds the evidence it presents. Its hypothetical scenarios establish plausibility and urgency but do not adequately model defensive capabilities, detection mechanisms, coordinated shutdowns, or alternative outcomes. The proposed regulation of advanced computing resources also raises concerns relating to institutional legitimacy, concentrated authority, equitable participation, and the technological dependence of developing countries. The review concludes that the book is most persuasive as an argument for precautionary governance rather than as a definitive prediction of extinction. Its central contribution is the proposition that uncertainty surrounding catastrophic harm should strengthen not weaken the requirement for rigorous safety evidence before advanced AI systems are deployed.
Scroll to read the preview. Download for the complete document.
References
Birhane, A. (2020). Algorithmic colonization of Africa. SCRIPTed, 17(2), 389–409. https://doi.org/10.2966/scrip.170220.389
Grace, K., Stewart, H., Sandkuehler, J. F., Thomas, S., Weinstein-Raun, B., Brauner, J., & Korzekwa, R. C. (2024). Thousands of AI authors on the future of AI (arXiv:2401.02843). arXiv. https://doi.org/10.48550/arXiv.2401.02843
Greenblatt, R., Denison, C., Wright, B., Roger, F., MacDiarmid, M., Marks, S., Treutlein, J., Belonax, T., Chen, J., Duvenaud, D., Khan, A., Michael, J., Mindermann, S., Perez, E., Petrini, L., Uesato, J., Kaplan, J., Shlegeris, B., Bowman, S. R., & Hubinger, E. (2024). Alignment faking in large language models (arXiv:2412.14093). arXiv. https://doi.org/10.48550/arXiv.2412.14093
Sastry, G., Heim, L., Belfield, H., Anderljung, M., Brundage, M., Hazell, J., O’Keefe, C., Hadfield, G. K., Ngo, R., Pilz, K., Gor, G., Bluemke, E., Shoker, S., Egan, J., Trager, R. F., Avin, S., Weller, A., Bengio, Y., & Coyle, D. (2024). Computing power and the governance of artificial intelligence (arXiv:2402.08797). arXiv. https://doi.org/10.48550/arXiv.2402.08797
United Nations. (2015). Transforming our world: The 2030 agenda for sustainable development (A/RES/70/1). United Nations General Assembly.
Yudkowsky, E., & Soares, N. (2025). If anyone builds it, everyone dies: Why superhuman AI would kill us all. Little, Brown and Company.
Metrics are updated in real time as the article is accessed and downloaded.
Comments
Leave a Comment
