Scientists seek improved sign language on smartphones

 

Gallery

By Stewart Mitchell

Posted on 18 Aug 2010 at 08:39

Engineers in the US are hoping to make smart phones more useful for deaf people by improving technology to make sign language a viable option, even over slower mobile phone services.

Scientists at the University of Washington say they have developed the first device able to transmit American Sign Language over US mobile networks and are now testing the tool with deaf and hard-of-hearing students.

"This is the first study of how deaf people in the United States use mobile video phones," said project leader Eve Riskin, a UW professor of electrical engineering.

In an effort to save bandwidth while maintaining image quality where it matters, the scientists have developed a system that optimises compression to increase clarity around the face and hands.

The researchers claim they have brought the data rate down to 30Kbits/sec while still delivering intelligible sign language.

The technology, dubbed MobileASL, can also detect when either party is actually signing, the scientists said, meaning phones effectively switch off broadcast mode to save batteries during video exchanges.

According to the engineering team, the system makes calls cheaper and improves reliability on slower networks, even on devices that might have the capacity to deliver higher quality video.

This summer's field test involving 11 participants is intended to show the team how people use the tool in their daily lives and what obstacles they encounter, in advance of a possible widespread roll-out.

"We know these phones work in a lab setting, but conditions are different in people's everyday lives," Riskin said. "The field study is an important step toward putting this technology into practice."