The men trying to save us from the machines
Posted on 21 Jun 2013 at 10:52
Will computers grow so intelligent they wipe out the human race? Nicole Kobie meets the team guarding against that very threat
Are you more likely to die from cancer or be wiped out by a malevolent computer?
That thought has probably never occurred to you, but it’s been bothering one of the co-founders of Skype so much he’s teamed up with Oxbridge researchers who are trying to predict what machine super-intelligence will mean for the world, in order to mitigate the existential threat of new technology – that is, the chance it will destroy humanity.
Technology has long been a source of danger in the fertile imaginations of sci-fi novelists, but the idea is gaining academic support, with researchers at the University of Oxford’s Future of Humanity Institute (FHI) joining those from the newly launched Centre for the Study of Existential Risk (CSER) at the University of Cambridge to look more widely at the possible repercussions of nanotechnology, robotics, artificial intelligence and other innovations.
The concept is simple, but the solutions are anything but. The researchers are trying to avoid a situation where we outsmart ourselves, and create a system that can in turn invent its own technologies, which could "steamroll" humanity – not because it’s evil, but simply because we couldn’t foresee the long-term ramifications of how we programmed it.
Weighing up the risks
This idea has been studied since 2005 by the FHI, which was last year joined by the CSER, founded by Huw Price, Bertrand Russell professor of philosophy at the University of Cambridge, astronomer royal Lord Martin Rees, and Jaan Tallinn, co-founder of Skype.
Are we more likely to die from an AI accident than from cancer or heart disease?
The institute was sparked in part by a conversation between Price and Tallinn, during which the latter wondered, "in his pessimistic moments", if he’s "more likely to die from an AI accident than from cancer or heart disease".
The CSER launch announcement started with what sounds like the premise of a nerdy joke, but quickly became more serious: "A philosopher, a scientist and a software engineer have come together to propose a new centre at Cambridge to address developments in human technologies that might pose ‘extinction-level’ risks to our species, from biotechnology to artificial intelligence."
It sounds fantastical, but the trio, and their Oxford colleagues, are deadly serious. The work has long roots, too. In 1965, Irving Good – a friend of Alan Turing who worked at Bletchley Park – described the first "ultra-intelligent machine" in a positive light in a New Scientist paper, notes the CSER.
"This machine, he continued, would be the ‘last invention’ that mankind will ever make, leading to an ‘intelligence explosion’ – an exponential increase in self-generating machine intelligence. For Good, who went on to advise Stanley Kubrick on 2001: A Space Odyssey, the ‘survival of man’ depended on the construction of this ultra-intelligent machine," the CSER release notes said.
"While few would deny the benefits humanity has received as a result of its engineering genius – from longer life to global networks – some are starting to question whether the acceleration of human technologies will result in the survival of man, as Good contended, or if in fact this is the very thing that will end us," the CSER stated solemnly.
At the core of this is an idea commonly referred to as "singularity" – the point at which technology can start to make its own technology and become more advanced than us, making it impossible to predict what comes next.
Philosopher Nick Bostrom, the founder of Oxford’s FHI, hesitates to use that word, since it means "so many things to different people, all rolled up into this bundle of breathless expectation". Instead, as he said at a conference held by The Economist earlier this year, he simply refers to “super-intelligence".
For more details about purchasing this feature and/or images for editorial usage, please contact Jasmine Samra on email@example.com
- Sony Xperia Z3 specs leak online
- iPhone 6 release date, rumours, specs and features: when will the iPhone 6 come out in the UK?
- Windows 8.2: release date, features and free cloud version
- Samsung Galaxy Alpha release date, specs and rumoured price in the UK
- Vodafone has worst reception but Ofcom tests questioned
- Boxed iPhone 6 photos leak online
- Still on IE8? You've got 18 months to upgrade
- iPhone 6 launch event tipped for 9 September
- Feature updates coming to Patch Tuesday
- What's new in OS X 10.10 Yosemite Developer Preview 5 and iOS 8 beta 5?
- 20 years of PC Pro: our greatest review mistakes
- 20 years of PC Pro: our first A-List
- Wikipedia's "right to be forgotten" protest hits the wrong note
- 3D printing hits the high street for plastic selfies
- 20 years of PC Pro: What amazed us in our first issue
- How Google Glass ruined my lunch hour
- Smartphone battery packs: can a USB power pack beat the festival battery blues?
- Windows Easy Transfer – not so "easy" in Windows 8.1
- Formula 1: what a difference virtualisation makes
- Office of the future: comfy chairs and tablets everywhere