"The inherent unpredictability and uncontrollability of these systems presents massive risks as we get closer to superintelligent systems. And even if one brilliant scientist found a solution, without any government intervention there is no one to stop a different company, or country, from rushing ahead with superintelligent AI that can kill everyone."
https://www.persuasion.community/p/time-for-a-global-moratorium-on-superintelligenc?publication_id=61579&post_id=203271580&isFreemail=true&r=3ikjv&triedRedirect=true