Vision & Cognition Laboratory

Department of Computer Science, Drexel University

 
home  |  projects  |  people  |  publications  |  facilities  |  sponsors

EMMA

To provide more detailed accounts of behavior, many recent computational cognitive models have attempted to predict a person's eye movements during the execution of a given task. However, the vast majority of these models do not actually predict eye movements, but rather the shifts of visual attention between visual objects; this distinction, which may seem unimportant, actually causes serious problems when comparing model predictions to human data (e.g., consider a model of reading that predicts fixations on every word, when we know people often skip words). We have developed a computational model, EMMA, that bridges this gap and accounts for the relationship between eye movements, visual attention, and cognitive processes. EMMA (Eye Movements and Movement of Attention) incorporates a close but indirect link between eye movements and visual attention, thus enabling predictions of common eye-movement phenomena such as skipped or multiple fixations on a visual object. In addition, EMMA has been integrated with the ACT-R / PM cognitive architecture, allowing EMMA + ACT-R models to capture higher-level cognitive phenomena as well as lower-level eye- movement phenomena. We have successfully applied EMMA to predict human eye movements in such domains as reading, equation solving, and menu selection, and we also employ EMMA as an integral part of our integrated driver model.

Primary Reference

Salvucci, D. D. (2001). An integrated model of eye movements and visual encoding. Cognitive Systems Research, 1(4), 201-220.

Related References

Salvucci, D.D., & Anderson, J.R. (2001). Automated eye-movement protocol analysis. Human-Computer Interaction, 16, 39-86.

Salvucci, D. D. (2000). A model of eye movements and visual attention. In Proceedings of the Third International Conference on Cognitive Modeling(pp. 252-259). Veenendaal, The Netherlands: Universal Press.