Eye Gaze and Voice Integration Software

EyeTalk®

EyeTalk® is a software technology that integrates voice recognition and eye-tracking to control a computer interface without using the hands.

Diagram of Eye and Voice Interaction

Eye-tracking, to compute the user's point-of-gaze on a computer screen, is helpful in determining the object of interest such as a file or program. Voice commands provide additional context about what the user wishes to accomplish. For example, by visually acquiring a program icon, and then uttering "open" or "start," the user can convey his/her intent to start a particular program. If this were to be accomplished by voice alone, it would be necessary to utter a very specific command, such as "open the word processing program."  Not only is such a command relatively difficult to remember, it may tax the speech recognition program's ability to reliably parse the user's command. Combining eye and voice simplifies the task of inferring a user's intent to accomplish his/her goal.

FEATURES

  • Eye point-of-gaze input controls movement of the cursor
  • Voice recognition parses command verbalizations
  • Speech and eye gaze are temporally associated to infer user intent and execute desired commands (see "Principles and Guidelines for the Design of Eye Voice Interaction Dialogs")
  • An easy to use vocabulary definition tool allows the user to map verbal commands to specific graphical user interface actions (e.g., Page Up, Left Click, Open)
  • Works with any eye-tracker that is capable of outputting point-of-gaze data over a serial port

APPLICATIONS

as well as aerospace and military applications:

SYSTEM REQUIREMENTS

  • PC with Windows® XP, Vista, 2000
  • Serial port
  • Any eye-tracking system capable of outputting point-of-gaze over a serial port
  • USB 2.0 port

PRICE AND AVAILABILITY

  • Call for details

For more information, please send email with questions to: sales@eyetalksystems.com