Malicious artificial intelligence should be prevented

Jan 16, 2015 16:11 GMT  ·  By

Even though there is little chance we'll see artificial “human” intelligence in our lifetimes (probably), the term is so widely used (misused, really) that there is actual, real concern over whether or not we are spelling our own doom by inventing them.

In fact, some people have begun to actively take measures against the possibility of AIs becoming less than beneficial to mankind.

Granted, Elon Musk phrased it differently when he made a donation to that purpose, saying it's “aimed at keeping AI beneficial to humanity.”

More specifically, Elon Musk has donated $10 million / €8.7 million in order to provide a momentum for jump-starting research on AI safety.

Clearly, people aren't quite certain that the three laws of robotics, as coined by Isaac Asimov, are going to be sufficient. Either that, or they just don't have a good hold on how to implement them so that the spirit rather than the letter of the law is enforced.

Musk seems to be quite wary of artificial intelligence, saying that creating it is “summoning the demon.” Hyperbole it may have been, but his opinion on the matter is clear.

Many people agree with Musk's caution, like Skype-founder Jaan Tallinn, who compared AI with building a rocket. First you do your best to maximize acceleration, then you focus on steering.

Clearly, the point here is to make sure the steering system is well and truly viable before AIs take off.