Publications

Saliency analysis of eye tracking in children with cortical/cerebral visual impairment (CVI) enabled by machine learning

Abstract

Purpose: Cortical/cerebral visual impairment (CVI) is a leading cause of pediatric visual impairment and is characterized by abnormalities of higher-order visual processing and visual attention. However, children with CVI have limited ability to cooperate with standard methods for assessing these abnormalities. In this study, we combined machine learning (saliency modeling) with a passive (ie, no active task requirements) eye tracking protocol to evaluate visual attention to low-and high-level features in children with CVI.
Methods: 42 children with CVI and 29 age-matched controls (≤ 12 years old) were prospectively recruited. Eyes were tracked while participants viewed a series of images on a monitor. Saliency maps were generated using SegCLIP, a deep neural network for image segmentation based on large-scale language pre-training (CLIP). SegCLIP allows prompting any feature of interest, resulting in a corresponding saliency map (Fig 1). Both low-level (eg, texture) and high-level (eg, faces) maps were generated. For each participant, fixation saliency values were calculated for each trial per each map (Fig 2). Data from children with CVI and controls were compared using Mann-Whitney tests.
Results: CVI patients produced atypical fixation patterns compared to controls. Among others, CVI patients fixated less to human faces (p= 0.0004) and textures (p= 0.001). Instead, they preferred fixating on backgrounds (p= 0.001). Children with CVI also produced significantly shorter fixations to regions of increased complexity (p= 0.007).
Conclusions: Children with CVI exhibit distinct fixation patterns, focusing on backgrounds rather than features …

Date
June 17, 2024
Authors
Melinda Chang, Kleanthis Avramidis, Rahul Sharma, Mark Borchert, Shrikanth Narayanan
Journal
Investigative Ophthalmology & Visual Science
Volume
65
Issue
7
Pages
1501-1501
Publisher
The Association for Research in Vision and Ophthalmology