The men trying to save us from the machines
Posted on 21 Jun 2013 at 10:52
Will computers grow so intelligent they wipe out the human race? Nicole Kobie meets the team guarding against that very threat
Are you more likely to die from cancer or be wiped out by a malevolent computer?
That thought has probably never occurred to you, but it’s been bothering one of the co-founders of Skype so much he’s teamed up with Oxbridge researchers who are trying to predict what machine super-intelligence will mean for the world, in order to mitigate the existential threat of new technology – that is, the chance it will destroy humanity.
Technology has long been a source of danger in the fertile imaginations of sci-fi novelists, but the idea is gaining academic support, with researchers at the University of Oxford’s Future of Humanity Institute (FHI) joining those from the newly launched Centre for the Study of Existential Risk (CSER) at the University of Cambridge to look more widely at the possible repercussions of nanotechnology, robotics, artificial intelligence and other innovations.
The concept is simple, but the solutions are anything but. The researchers are trying to avoid a situation where we outsmart ourselves, and create a system that can in turn invent its own technologies, which could "steamroll" humanity – not because it’s evil, but simply because we couldn’t foresee the long-term ramifications of how we programmed it.
Weighing up the risks
This idea has been studied since 2005 by the FHI, which was last year joined by the CSER, founded by Huw Price, Bertrand Russell professor of philosophy at the University of Cambridge, astronomer royal Lord Martin Rees, and Jaan Tallinn, co-founder of Skype.
Are we more likely to die from an AI accident than from cancer or heart disease?
The institute was sparked in part by a conversation between Price and Tallinn, during which the latter wondered, "in his pessimistic moments", if he’s "more likely to die from an AI accident than from cancer or heart disease".
The CSER launch announcement started with what sounds like the premise of a nerdy joke, but quickly became more serious: "A philosopher, a scientist and a software engineer have come together to propose a new centre at Cambridge to address developments in human technologies that might pose ‘extinction-level’ risks to our species, from biotechnology to artificial intelligence."
It sounds fantastical, but the trio, and their Oxford colleagues, are deadly serious. The work has long roots, too. In 1965, Irving Good – a friend of Alan Turing who worked at Bletchley Park – described the first "ultra-intelligent machine" in a positive light in a New Scientist paper, notes the CSER.
"This machine, he continued, would be the ‘last invention’ that mankind will ever make, leading to an ‘intelligence explosion’ – an exponential increase in self-generating machine intelligence. For Good, who went on to advise Stanley Kubrick on 2001: A Space Odyssey, the ‘survival of man’ depended on the construction of this ultra-intelligent machine," the CSER release notes said.
"While few would deny the benefits humanity has received as a result of its engineering genius – from longer life to global networks – some are starting to question whether the acceleration of human technologies will result in the survival of man, as Good contended, or if in fact this is the very thing that will end us," the CSER stated solemnly.
At the core of this is an idea commonly referred to as "singularity" – the point at which technology can start to make its own technology and become more advanced than us, making it impossible to predict what comes next.
Philosopher Nick Bostrom, the founder of Oxford’s FHI, hesitates to use that word, since it means "so many things to different people, all rolled up into this bundle of breathless expectation". Instead, as he said at a conference held by The Economist earlier this year, he simply refers to “super-intelligence".
For more details about purchasing this feature and/or images for editorial usage, please contact Jasmine Samra on email@example.com
- What is Google Inbox?
- Windows 10 release date, features and how to get the Technical Preview
- Google announces the Nexus 6, Nexus 9 and the arrival of Android Lollipop
- Lenovo and Ashton Kutcher launch Yoga Tablet 2 Pro, Yoga Tablet 2 and Yoga 3 Pro
- Lenovo Yoga event live stream: watch Ashton Kutcher's tablet launch live
- HTC shows off Desire Eye selfie phone and periscope-like camera
- Xim: the slideshow app to get excited about
- Adobe has more apps for iOS, but none for Android
- How to download and install Windows 10 Technical Preview
- iPhone 6 Plus "less likely to bend than HTC One"
- Google Glass: mugger bait, pub problem and other lessons learned from two dangerous weeks
- Twitter, please don't fiddle with my feed
- How Satya Nadella can get some pay-raise karma
- Windows 10: a step back to go forward
- Michael Dell: Cloud infrastructure is the roads, bridges and highways of the 21st century
- How to check your identity hasn’t been sold to the hackers
- Tim Cook: this is how much TV has changed since the 70s
- Westminster wins the .London battle
- 20 years of PC Pro: from deep pan pizza to virtualisation
- Five reasons why the Apple Watch leaves me cold