Should we build killer, autonomous robots?

[summer]

Nice knowing you, humanity. 


NPR

In his lab at George Mason University in Virginia, Sean Luke has all kinds of robots: big ones with wheels; medium ones that look like humans. And then he has a couple of dozen that look like small, metal boxes.



He and his team at the Autonomous Robotics Lab are training those little ones to work together without the help of a human.



In the future, Luke and his team hope those little robots can work like ants — in teams of hundreds, for example, to build houses, or help search for survivors after a disaster.




When Robots Can Kill, It's Unclear Who Will Be To Blame

"These things are changing very rapidly and they're changing much faster than we sort of expected them to be changing recently," Luke says.



New algorithms and huge new databases are allowing robots to navigate complex spaces, and artificial intelligence just achieved a victory few thought would ever happen: A computer made by Google beat a professional human in a match of Go.



It doesn't take much imagination to conjure a future in which a swarm of those robots are used on a battlefield. And if that sounds like science fiction, it's not.



Earlier this month representatives from more than 82 countries gathered in Geneva to consider the repercussions of that kind of development. In the end, they emerged with a recommendation: The key U.N. body that sets norms for weapons of war should put killer robots on its agenda.



A 'Moral Threshold'



Human Rights Watch and Harvard Law School's International Human Rights Clinic added to the urgency of the meeting by issuing a report calling for a complete ban on autonomous killer robots.




Bonnie Docherty, who teaches at Harvard Law School and was the lead author of the report, says the technology must be stopped before humanity crosses what she calls a "moral threshold."



"[Lethal autonomous robots] have been called the third revolution of warfare after gunpowder and nuclear weapons," she says. "They would completely alter the way wars are fought in ways we probably can't even imagine."



Docherty says killer robots could start an arms race and also obscure who is held responsible for war crimes. But above all, she says, there is the issue of basic human rights.



"It would undermine human dignity to be killed by a machine that can't understand the value of human life," she says.



Paul Scharre, who runs a program on ethical autonomy at the Center for a New American Security and was also in Geneva for the talks, says that it's pretty clear that nobody wants "Cylons and Terminators."



Researchers Warn Against 'Autonomous Weapons' Arms Race

In truth, he says, the issue of killer robots is more complicated in reality than it is in science fiction.



Take, for example, the long-range anti-ship missile Lockheed Martin is developing for the U.S. military. The LRASM can lose contact with its human minders yet still scour the sea with its sensors, pick a target and slam into it.



"It sounds simple to say things like: 'Machines should not make life-or-death decisions.' But what does it mean to make a decision?" Scharre asks. "Is my Roomba making a decision when it bounces off the couch and wanders around? Is a land mine making a decision? Does a torpedo make a decision?"



'Meaningful Human Control'



Scharre helped write U.S. policy on killer robots and he likes where things ended up.



Department of Defense Directive 3000.09 requires a high-ranking Defense official to approve unusual uses of autonomous technology and also calls for those systems to always keep "appropriate levels of human judgment over the use of force."



Proponents of a ban say that policy leaves too much wiggle room. They advocate that all military weapons maintain "meaningful human control."



These 1024 "kilobots" can shuffle into any shape their creator desires. Each robot is a little bigger than a quarter, standing on three little metal legs that vibrate to make it move.


Georgia Tech's Ron Arkin, who is one of the country's leading roboethicists, says hashing out that distinction is important but the potential benefits of killer robots should not be overlooked.



"They can assume far more risk on behalf of a noncombatant than any human being in their right mind would," he says. "They can potentially have better sensors to cut through the fog of war. They can be designed without emotion — such as anger, fear, frustration — which causes human beings, unfortunately, to err."



Arkin says robots could become a new kind of precision-guided weapon. They could be sent into an urban environment, for example, to take out snipers. He says that's probably far into the future, but what he knows right now is that too many innocent people are still being killed in war.



"We need to do something about that," he says. "And technology affords one way to do that and we should not let science fiction cloud our judgment in terms of moving forward."



Arkin says one day killer robots could be so precise that it might become inhumane not to use them.



The next meeting in Geneva is set for December, when a U.N. group will decide whether to formally start developing new international law governing killer robots. Since the last meeting, 14 countries have joined in calling for a total ban.

[wawa]

I have concerns.

[josieposy]

I think they made a movie or two (or 50) about this.

[elleblue]

There's no way this could end badly. Mmhmmm.

[meshaliuknits]

The robots always gain sentience & enslave and/or destroy humanity. It's as unavoidable as death and taxes.

[pixy0stix]

Well, nice knowing you guys.

[mrsbro]

Apr 29, 2016 6:32:36 GMT -5 wawa said:

I have concerns.

At least we aren't alone. thank you baby Jesus.


Since the last meeting, 14 countries have joined in calling for a total ban

[aurora]

Apr 29, 2016 9:09:53 GMT -5 meshaliuknits said:

The robots always gain sentience & enslave and/or destroy humanity. It's as unavoidable as death and taxes.

Today's robots aren't sophisticated enough for that.

I'm not making any predictions about tomorrow's though.

[underwaterrhymes]

[eponinepontmercy]

[downtoearth]

No, but we should build Big Hero 6 robots!

[katieido]

What could possibly go wrong? ?

[josieposy]

Apr 29, 2016 15:40:09 GMT -5 downtoearth said:

No, but we should build Big Hero 6 robots!

It's funny you mention this because when they were talking about those little bots at the beginning of the article, all I can think of were Hiro's microbots. We see how that worked out!

[meshaliuknits]

Apr 29, 2016 14:44:59 GMT -5 aurora said:

Apr 29, 2016 9:09:53 GMT -5 meshaliuknits said:

The robots always gain sentience & enslave and/or destroy humanity. It's as unavoidable as death and taxes.

Today's robots aren't sophisticated enough for that.

I'm not making any predictions about tomorrow's though.

It's just a matter of time. First they play dumb and learn our weaknesses, then BAM! End of civilization as you know it.