Kinect: taking control of computing
Posted on 20 May 2011 at 13:41
Stuart Andrews discovers how a pack of innovative hackers has transformed Microsoft's Kinect into much more than a plaything
With ten million sold since November, it’s the fastest-selling consumer electronics device in history. It’s also the most hyped console accessory of the past five years, and the only technology that can – in Microsoft’s words – make you the games controller.
Combining cameras and 3D depth sensors with voice and facial recognition, Kinect can capture motion from up to 48 joints in the human body, tell you apart from other members of your household, and allow you to control video games using speech, gestures and full-body motion. It’s made the Wii look like yesterday’s toy, and brought the Xbox 360 to a whole new market.
Kinect is fast becoming much more than a plaything
However, Kinect is fast becoming much more than a plaything. Working with open-source tools and unofficial drivers, a community of enthusiasts has hooked up Kinect to the PC.
These can-do coders have been creating home-grown gesture controls for Windows and developing some of the weirdest demo projects you’ve ever seen.
From virtual surgery, to gesture-controlled Windows applications and human body artworks being smashed into a million pieces, Kinect has virtually limitless potential.
That hasn’t gone unnoticed at Microsoft. Kinect’s creator has never denied that it has wider ambitions, and the release of a new official SDK should make it easier to ensure Kinect performs.
Suddenly, Kinect feels like the start of something big. In fact, senior figures at Microsoft see it as the beginning of a new era in computing.
It wasn’t always this way. Kinect originally stems from the somewhat desperate situation that faced Microsoft’s entertainment division in mid-2007.
While the Xbox 360 was a hit with hard-core gamers, it wasn’t breaking the mainstream audience in the same way as Nintendo’s faster-selling, motion-controlled Wii.
Microsoft needed a new twist, and put a 31-year-old technology guru, Alex Kipman, in charge of a project that could push the console in a different direction. In June 2009, Kipman’s group was ready to demonstrate its wonder product, codenamed Project Natal.
Natal wasn’t all Microsoft’s own work. The basis of the hardware came from a Tel Aviv startup called PrimeSense, which demonstrated a revolutionary 3D full-body motion sensor in 2006.
Find out moreTop five Kinect hacks
PrimeSense’s unit contained a near-infrared depth sensor and a matching projector, along with a specialist system-on-a-chip (SoC) processor and an optional RGB video camera.
Using a system PrimeSense calls Light Coding, the projector floods the scene with near-infrared light, beyond the visible range of the human eye.
A regular CMOS sensor – the same kind found in many webcams – captures the light reflecting back and passes it on to the SoC. This uses complex algorithms to convert the light data into a full 3D-depth map, and this can then be combined with data from the RGB camera to give each 3D pixel a colour value.
Capture all this information, identify which parts are human, and you have all you need to operate full-body, motion-controlled 3D games.
Games were always the driving force behind PrimeSense’s technology.
However, it was Microsoft that recognised the sensor’s potential and made it the core technology in Natal.
Microsoft added a couple of extras to the reference design, including a more sophisticated, multi-array microphone and a motorised stand that would automatically adjust the position of the camera to keep players in the frame.
Maybe in the future they could change its name to HAL.
Give it a red luminous Eye and teach it to sing
"Daisy , Daisy"
with apologies to Stanley Kubrick :-)
By Jaberwocky on 20 May 2011
That was an excellent article, I thoroughly enjoyed reading that.
I think the next few years are going to prove very, very exciting in this area - as we're now starting to get easy to use, advanced technology of the science fiction variety. Give it a few more years and we should end up with a simple, intuitive, intelligent PC even my mother would want to use. Now THAT would be impressive technology!
By Mr_John_T on 21 May 2011
What a Brilliant article, there's hope for you yet PCPro :)
Nice to see journalists using 'Hacker' with it's original and correct meaning too.
By pinero50 on 22 May 2011
For more details about purchasing this feature and/or images for editorial usage, please contact Jasmine Samra on firstname.lastname@example.org
- What is Google Inbox?
- Windows 10 release date, features and how to get the Technical Preview
- Google announces the Nexus 6, Nexus 9 and the arrival of Android Lollipop
- Lenovo and Ashton Kutcher launch Yoga Tablet 2 Pro, Yoga Tablet 2 and Yoga 3 Pro
- Lenovo Yoga event live stream: watch Ashton Kutcher's tablet launch live
- HTC shows off Desire Eye selfie phone and periscope-like camera
- Xim: the slideshow app to get excited about
- Adobe has more apps for iOS, but none for Android
- How to download and install Windows 10 Technical Preview
- iPhone 6 Plus "less likely to bend than HTC One"
- Google Glass: mugger bait, pub problem and other lessons learned from two dangerous weeks
- Twitter, please don't fiddle with my feed
- How Satya Nadella can get some pay-raise karma
- Windows 10: a step back to go forward
- Michael Dell: Cloud infrastructure is the roads, bridges and highways of the 21st century
- How to check your identity hasn’t been sold to the hackers
- Tim Cook: this is how much TV has changed since the 70s
- Westminster wins the .London battle
- 20 years of PC Pro: from deep pan pizza to virtualisation
- Five reasons why the Apple Watch leaves me cold