Saturday, May 3, 2008

Georgia Tech Gesture Toolkit: Supporting Experiments in Gesture Recognition

Georgia Tech Gesture Toolkit: Supporting Experiments in Gesture Recognition

Westeyn et al present the Georgia Tech Gesture Toolkit and several example applications created with it. GT2k is built on HTK, an HMM toolkit. Essentially, users create HMMs for each gesture and a grammar that combines isolated gestures into sequences with meaning. The toolkit automatically trains the HMMs with data that has been annotated by the application creator. The system also allows for cross-validation to be used to determine how well the system will perform on real data. They also present several applications such as a workshop activity recognizer.

Discussion
They really don't add much to HTK. Really its just a new coat of paint so that HTK looks like its doing something new.

Reference

Westeyn, Brashear, Atrash, Starner. Georgia Tech Gesture Toolkit: Supporting Experiments in Gesture Recognition. Proceedings of the 5th International Conference on Multimodal Interfaces. Vancouver, British Columbia, Canada (2003), 85-92.

No comments: