Gesture Recognition Allows Computers to Understand the Handicapped

Understanding that handicapped people are at a disadvantage compared to other computer users, scientists at the Macquarie University, in Sydney, Australia, devised two new computer-user interfaces that employ movements and gestures to interpret the requests that a person addresses a computer. Two cameras, gloves and a computer program are all the parts the computer comprises, but its creators say that future investments in the project could lead to the creation of more advanced prototypes.

”We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows any user to control dynamically in real-time simulators or other programs. DRive allows a quadriplegic person to control a car interface using input from just two LEDs on an over-shoulder garment. For more precise gestures, a DataGlove user can gesture using their fingers,” says Virtual and Interactive Simulations of Reality Research Group scientist, Manolya Kavakli.

People using the new system will wear “data gloves,” which are outfitted with sensors that the two cameras, placed on each side of the user, can detect and interpret from a series of predefined commands. This allows the user to customize the settings on his or her system, making the experience of using the computer all the more enjoyable.

With future funds, the Australian team plans to extend their design, and to perfect its sensors, in that they could interpret complex movements, such as grasping, strumming, and stroking, to make the handicapped able to communicate with their computers.

The main reason that drove Kavakli to start creating the two systems was the fact that regular input devices, such as mice and keyboards, are often designed in an unergonomic fashion and rarely address anyone else besides regular people. But those with impairments need to use the computers too, so she thought she would pull her resources together and create something to help them out.