Exploring Gesture and Gaze Proxies to Communicate Instructor's Nonverbal Cues in Lecture Videos

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningfagfællebedømt

Teaching via lecture video has become the defacto standard for remote education, but videos make it difficult to interpret instructors' nonverbal referencing to the content. This is problematic, as nonverbal cues are essential for students to follow and understand a lecture. As remedy, we explored different proxies representing instructors' pointing gestures and gaze to provide students a point of reference in a lecture video: no proxy, gesture proxy, gaze proxy, alternating proxy, and concurrent proxies. In an online study with 100 students, we evaluated the proxies' effects on mental effort, cognitive load, learning performance, and user experience. Our results show that the proxies had no significant effect on learning-directed aspects and that the gesture and alternating proxy achieved the highest pragmatic quality. Furthermore, we found that alternating between proxies is a promising approach providing students with information about instructors' pointing and gaze position in a lecture video.

OriginalsprogEngelsk
TitelCHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
Antal sider7
ForlagAssociation for Computing Machinery, Inc.
Publikationsdato2023
Artikelnummer113
ISBN (Elektronisk)9781450394222
DOI
StatusUdgivet - 2023
Begivenhed2023 CHI Conference on Human Factors in Computing Systems, CHI 2023 - Hamburg, Tyskland
Varighed: 23 apr. 202328 apr. 2023

Konference

Konference2023 CHI Conference on Human Factors in Computing Systems, CHI 2023
LandTyskland
ByHamburg
Periode23/04/202328/04/2023
SponsorACM SIGCHI, Apple, Bloomberg, Google, NSF, Siemens

Bibliografisk note

Funding Information:
This project is funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation, 425867974, to Anke Huckauf and Enrico Rukzio) and is part of Priority Program SPP2199 Scalable Interaction Paradigms for Pervasive Computing Environments. T. Hirzle was supported by the HumanE AI Network from the European Union’s Horizon 2020 research and innovation program under grant agreement No 952026, and the Pioneer Centre for AI, DNRF grant number P1.

Publisher Copyright:
© 2023 Owner/Author.

ID: 347300683