interesting thoughts there. but what I'm most scared about is that we already know it doesn't take superhuman intelligence to lead people to doom. capitalist corporations with their ugly incentive systems to get people to want to behave in self-harming ways, charismatic nazi leaders who managed to get elected... what scares me about AI is that it can be trivially replicated, and populate the intertubes enough as to exploit not only the human vulnerabilities to charisma that brought us WWII, but also the push to mirroring behaviors around us. place enough bots behaving both human-like and in ways that promote a certain agenda in a community, and soon the behavior of humans in that community will shift towards that behavior