DARPA killer AI robots to ‘participate in own construction’
Posted by keelynet on June 6, 2009
Could we buildin some kind of non maskable interrupt that would prevent them from attacking humans along the lines of Asimov’s Rules of Robotics?
“You’ve got your robots which can make copies of themselves, of course. That’s pretty scary – a runaway exponentially-multiplying machine horde, potentially able to overrun the human race in an eyeblink. But how much more scary would it be if you had a machine which could not only make copies of itself once complete, but could also participate in its own construction while it was still being built? Really quite a lot more scary, we say here on the Reg mechanoid-armageddon desk. One should bear in mind that Dr Mike Cox of DARPA has already said that SELF could be placed in charge “in the near term” of heavily armoured, hideously beweaponed main battle tanks or strike planes laden with blockbuster bombs. “Tasks in its repertoire”, then, might include “destroy all moving objects within 100 miles not designated as ‘friendly'” or “mount an immediate armoured assault on Beijing, regardless of nuclear response”. The prospect of the software unilaterally “trying to perform those tasks to verify functionality” doesn’t seem reassuring. In any case, it seems plain that building a system focused on “high-level cognition” which can “participate in its own construction” will be fraught with difficulty. You might have a notion of what you’d like it to be, but it will have its own ideas. By definition, one would have no firm picture of just what would be unleashed upon an unsuspecting world at the end of the construction process – but you would know that it’d be potentially able to make more of itself, or indeed repair itself if it got damaged. It might also be rather difficult to stop the process of building the SELF, once it had advanced beyond a certain point. Frankly the only way to be sure it can be stopped would seem to be to stop it now.” – Source
This entry was posted on June 6, 2009 at 5:22 pm and is filed under Alternative Science, Computer Related, Gee Willikers!!!, Invention, Miscellaneous, Orthodox Science, Politics. You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.
Sorry, the comment form is closed at this time.