top of page

AR for Captions and Interpreting

This project examines the use of augmented reality (AR) smart glasses to provide real-time sign language interpretation and captioning for Deaf and Hard of Hearing (DHH) students in hands-on learning environments like science laboratories. Here, we evaluate the feasibility and trade-offs of AR-mediated access, focusing on reducing visual split attention and cognitive load during practical tasks. Additionally, our efforts investigate the broader educational ecosystem by assessing how heads-up displays impact interaction, pacing, and visual coordination among instructors, sign language interpreters, and captioners.

Publications

Reimagining the Augmented Reality Accessibility Ecosystem for Deaf Students: Service Provider Perspectives in Experiential Learning

HCI International 2026 Posters

Roshan Mathew, Roshan Peiris

Evaluating the Feasibility of Augmented Reality to Support Communication Access for Deaf Students in Experiential Higher Education Contexts

W4A '26: Proceedings of the 23rd International Web for All Conference

Roshan Mathew and Roshan Peiris

Project Team

Roshan Mathew
Wendy Dannels
Roshan Peiris
AIR-LAB-FINAL4.png
RIT_rgb_hor_w1.png

roshan.peiris@rit.edu

Accessible and Immersive Realities (AIR) Lab
School of Information
Golisano College of Computing and Information Sciences
Rochester Institute of Technology

© Copyright 2024 Roshan Peiris. All rights reserved.

bottom of page