Kinect reads sign language in real time
L33tdawg: Reminds me of the DiCOM-WAVE project from last year's HackWEEKDAY - an open source DICOM image viewer with Microsoft Kinect as its control interface.
Earlier this week at Microsoft's DemoFest in Redmond, Wash., the company's research arm showed off an incredible union of technologies that could finally usher in an inexpensive solution for people who want to communicate with a computer through sign language.
Dreamed up by researchers with the Chinese Academy of Sciences and Microsoft Research Asia, the system involves the use of a Kinect camera sensor, Bing's translation services, and some recognition software that detects American and Chinese sign language and converts it into computer text -- all on the fly.
Kinect's advanced body-tracking sensors and ability to read 3D depth of field provide what seems like a perfect platform for tracking the complex hand movements associated with sign language.