Artificial intelligence eventually could bring about mankind’s demise, according to renowned physicist Stephen Hawking. “Once humans develop [full] artificial intelligence, it would take off on its own and redesign itself at an ever-increasing rate,” he said. SpaceX and Tesla CEO Elon Musk, Hawking and futurist Ray Kurzweil “all share a vision of autonomous artificial intelligence that … we mere humans can’t keep up with,” said Dan Miller, founder and lead analyst with Opus Research.
If a thing can be designed and exploited for profit, then whatever needs to occur for that to happen is a foregone conclusion.
If legitimate responsible accountable forces do not create and develop controls for artificial intelligence we will all be at the mercy of illegitimate irresponsible unaccountable forces who do it for their own nefarious reasons, including "just because."
That said is is far wiser to be proactive than reactive.
Disable the ability for the approved AI's source code to be modified by any means post production, and make it fail safe against physical modification methods. Then any updated AI replacements versions would need to be vetted on a disconnected platform with no hard line connections to anything outside of the room in which it is being constructed perferably in a Faraday cage to mitigate foreign signals from getting inside and for protecting the outside world from any signal emitting from within the development platform. Couple the sandbox to a dead mans switch hard lined to explosives. So long as we are extremely careful in constructing the first AI's there should be no reason afterwards that they could conceivably be used to vet their successors. The human element would still be a vital part of the process, since it would be folly to entrust AI's to encode themselves or go unchecked before placing them in the wild.
Hawking Sounds Alarm Over AI’s End Game
Posted by: Katherine Noyes December 5, 2014 07:34 AMArtificial intelligence eventually could bring about mankind’s demise, according to renowned physicist Stephen Hawking. “Once humans develop [full] artificial intelligence, it would take off on its own and redesign itself at an ever-increasing rate,” he said. SpaceX and Tesla CEO Elon Musk, Hawking and futurist Ray Kurzweil “all share a vision of autonomous artificial intelligence that … we mere humans can’t keep up with,” said Dan Miller, founder and lead analyst with Opus Research.
If legitimate responsible accountable forces do not create and develop controls for artificial intelligence we will all be at the mercy of illegitimate irresponsible unaccountable forces who do it for their own nefarious reasons, including "just because."
That said is is far wiser to be proactive than reactive.
Me? I reckon in response to a possible AI threat I'd be wanting a low tech wide range high output EMP response option.
I may not be able to prevent an unknown from building an AI menace, but I can certainly take it out.