Eye-Hand Coordination Assessment Metrics Using a Multi-Platform Haptic System with Eye-Tracking and Motion Capture Feedback.

In this paper, we discuss the possibility to determine assessment metrics for eye-hand coordination, using a mapping between a robotic haptic device to a virtual environment, and correlating it with the eye-gaze and upper arm movements. Our goal is to develop, implement and refine a system that will assess and improve eye-hand coordination in individuals with disabilities. A detailed analysis of patterns was conducted by therapists in order to select various levels of difficulty that could be included in the system, and which would yield the greatest benefit in terms of assessment of coordination as well as in training. Participants were instructed to use a haptic device (Omni) to follow the trajectories. This was completed while video data were collected using a Vicon motion capture system. Readings of traced trajectories, time, and upper limb motions were recorded for further analysis. One of the patterns was chosen to develop a multi-platform haptic system to be virtually rendered with any haptic device and a Graphic User Interface (GUI) with options to guide the user along the chosen pattern using a haptic tunnel calculated by using B-splines. Two types of haptic tunnels are presented and evaluated: one that follows the mid path of the pattern, and one that takes the smoothest path through the pattern. Finally, the Pearson coefficient was chosen as a metric to correlate the haptic device and the eye-gaze coordinates recorded simultaneously while the user traces a path.