Interactive Storytelling with Gaze-Responsive Subtitles

StatusVoR
Dublin Core metadata
Alternative title
Authors
Duchowski, Andrew T.
Araújo Vieira, Patrícia
Pinto de Assis, Ítalo Alves
Krejtz, Krzysztof
Hughes, Chris J.
Orero, Pilar
Monograph
2025: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops
Monograph (alternative title)
Editor
Ghinea, George
Conci, Aura
Van den Broeck, Wendy
Viterbo, José
Willrich, Roberto
Date
2025
Place of publication
Publisher
Association for Computing Machinery (ACM)
Journal title
Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025)
Volume
Pages
19-25
DOI
ISSN
ISBN
.
eISBN
Series
Proceedings of the ACM International Conference on Interactive Media Experiences Workshops
Series number
ISSN of series
Weblink
https://sol.sbc.org.br/index.php/imxw/article/view/35221/35011
Access date
2025-06-06
Remarks
Abstract PL
Abstract EN
The paper describes an eye-tracking framework for offline analysis of and real-time interaction with gaze-responsive subtitled media. The eventual goal is to introduce and to evaluate gaze-responsive subtitles, which afford pausing of video when reading subtitles. Initial modes of interaction include: look-to-read and look-to-release. The former pauses video as long as gaze is detected over subtitles, the latter pauses video until gaze falls on subtitles. To avoid disrupted perception of media content, an additional ambient soundtrack matched to the general content of video is proposed. Note that this is potentially revolutionary as it would require an entirely novel approach to film direction. Just as Audio Description is now included in most modern films, ambient sound would also be needed to fill in brief temporal gaps when the user’s visual attention is directed toward subtitles. Concomitantly, the eye-tracking framework fosters quantitative analysis of attention to audiovisual content apart from qualitative evaluation on which most of subtitling standardization is based.
Abstract other
Keywords PL
Keywords EN
eye tracking
subtitles
interaction
Keywords other
Conference edition name
2025 ACM International Conference on Interactive Media Experiences
Conference place
Rio de Janeiro
Start date
2025-06-03
Finish date
2025-06-06
Sustainable Development Goals
SDG 4. Quality Education ,
SDG 5. Gender Equality ,
SDG 10. Reduced Inequalities
Exhibition title
Place of exhibition (institution)
Exhibition curator
Organisational Unit
Wydział Psychologii w Warszawie
Instytut Psychologii
URI
https://share.swps.edu.pl/handle/swps/1971
Type
Version
Version of Record
License type
cc-by
Except as otherwise noted, this item is licensed under the Attribution licence | Permitted use of copyrighted works
Funder
Time range from
Time range to
Contact person name
item.page.relation.dataset
Related publication
Related publication
Grant/project name
Views
Views7
Acquisition Date9.11.2025
Downloads
Downloads0
Acquisition Date20.10.2022