What’s more likely in the techno-fascist idiocracy of the 21st Century?
We somehow manage to turn statistical models into super-intelligence… or the incompetent, criminally-corrupt, sociopathic leadership at the top of capitalism train an AI to defend the rich from the working class — by training it to be the most efficient killing machine possible — integrate it into fully autonomous killing machines, and it (accurately) determines the most efficient way to kill 99% of humanity is to start a nuclear war?
Yeah I’ve said a number of times that the AI being designed today could easily destroy humans, but not because it becomes self aware. The more likely possibility is that this beta tool gets put in control of critical systems by someone cutting corners and bam, total meltdown. Not because the AI is intending to do harm, but instead simply because it is ill suited for the task and NOT an actual intelligence.
Yeah, I suppose Hanlon’s Razor applies to AI as well.
Exhibit A: most major companies in the past few years. Good thing so far it’s been mostly self harm. I’m sure a lesson has been learned and the race for AI in everything has stopped now. Right? Right?
AI being conscious or actively wanting to harm us isn’t the scenario most people worrying about the alignment problem are concerned about. The worry is that it ends up destroying us as a side product of something else it does. In a similar way humans destroy an anthill where we want to put up a house. We don’t do it because we want to harm ants.