Open Access Open Access  Restricted Access Subscription Access

Communication Board and Visual PerceptionTraining Contents with Gaze Tracking for Augmentative and Alternative Communication(AAC)


Affiliations
1 Department of Computer Engineering, Korea Polytechnic University, Siheung, Korea
2 Remed Co., Korea
 

This study proposed an gaze tracking system which detects the pupil and the center point of the glints from near-infrared camera images and, in order to use this system, implemented visual perception training contents and augmentative and alternative communication software. The center of the pupil and the center of two glint points of the eye images used for gaze tracking were extracted by using a model with four kinds of simple features. After using the calculated distance between the two centers to locate the relative position of the eye-gaze on the monitor, the x and y coordinates of the screen were mapped to match the gaze and the mouse pointer. The visual perception training contents for using the developed gaze tracking system consists of such components as visual acuity, eye movement speed, visual reaction rate, and visual concentration. Furthermore, software was implemented to enable an alternative means of communication to be used by symbols which convey the meaning of vocabulary being used in spoken language.

Keywords

Augmentative and Alternative Communication, Disabled, Gaze Tracking, Visual Perception.
User

Abstract Views: 189

PDF Views: 0




  • Communication Board and Visual PerceptionTraining Contents with Gaze Tracking for Augmentative and Alternative Communication(AAC)

Abstract Views: 189  |  PDF Views: 0

Authors

Ki-Young Kwon
Department of Computer Engineering, Korea Polytechnic University, Siheung, Korea
Jae-Yong An
Department of Computer Engineering, Korea Polytechnic University, Siheung, Korea
Sung-Wook Shin
Department of Computer Engineering, Korea Polytechnic University, Siheung, Korea
Se-Jin Yoon
Remed Co., Korea
Sung-Taek Chung
Department of Computer Engineering, Korea Polytechnic University, Siheung, Korea

Abstract


This study proposed an gaze tracking system which detects the pupil and the center point of the glints from near-infrared camera images and, in order to use this system, implemented visual perception training contents and augmentative and alternative communication software. The center of the pupil and the center of two glint points of the eye images used for gaze tracking were extracted by using a model with four kinds of simple features. After using the calculated distance between the two centers to locate the relative position of the eye-gaze on the monitor, the x and y coordinates of the screen were mapped to match the gaze and the mouse pointer. The visual perception training contents for using the developed gaze tracking system consists of such components as visual acuity, eye movement speed, visual reaction rate, and visual concentration. Furthermore, software was implemented to enable an alternative means of communication to be used by symbols which convey the meaning of vocabulary being used in spoken language.

Keywords


Augmentative and Alternative Communication, Disabled, Gaze Tracking, Visual Perception.



DOI: https://doi.org/10.17485/ijst%2F2016%2Fv9i45%2F128651