Automated Identification of Areas of Interest in Dynamic Head-Mounted Display Videos for Virtual Reality Forensic Psychology Applications

Research output: Chapter in Book/Conference proceedingPublished conference proceedingScientificpeer-review

Abstract

This paper introduces a novel software solution to address the challenges of automated identification of Areas of Interest (AOIs) in dynamic, head-mounted display virtual reality (VR) environments, with a focus on applications in forensic psychology. Traditional eye-tracking tools often require manual annotation of AOIs when analyzing moving objects, such as faces, in dynamic 360-degree VR scenarios—a process that is time-intensive. The presented software utilizes RetinaFace to generate consistent AOIs by dynamically tracking facial coordinates across video frames, accounting for variability in head movements. Outputs are seamlessly formatted for analysis in iMotions, enabling robust synchronization and visualization of gaze data. In a pilot study with 16 participants, validation against manual annotation confirmed the system’s high accuracy (92.2%). By automating a previously manual process, the software provides researchers with an efficient and scalable tool for analyzing complex visual attention data, significantly enhancing the feasibility of large-scale VR studies in forensic and psychological research. An empirical example illustrates how the software can be used.

Original languageEnglish
Title of host publicationVirtual, Augmented and Mixed Reality: 17th International Conference, VAMR 2025, Held as Part of the 27th HCI International Conference, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part I
EditorsJessie Y. C. Chen, Gino Fragomeni
PublisherSpringer
Pages50-64
ISBN (Electronic)978-3-031-93700-2
ISBN (Print)9783031936999
DOIs
Publication statusPublished - 31 May 2025
MoE publication typeA4 Article in a conference publication
Event27th International Conference on Human-Computer Interaction -
Duration: 22 Jun 202527 Jun 2025

Publication series

NameLecture Notes in Computer Science
Volume15788 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference27th International Conference on Human-Computer Interaction
Abbreviated titleHCII
Period22/06/2527/06/25

Fingerprint

Dive into the research topics of 'Automated Identification of Areas of Interest in Dynamic Head-Mounted Display Videos for Virtual Reality Forensic Psychology Applications'. Together they form a unique fingerprint.

Cite this