Automatic recognition of gesture qualities in speech delivery in VR - work-in-progress

StatusVoR
Simple item page
dc.abstract.enGesture use during public speaking can be analyzed as an aspect of speaker performance as well as an indicator of speaker emotions. Recognizing gesture quality rather than identifying specific gestures presents an underexplored challenge compared to traditional gesture recognition in virtual reality (VR). To that end, we use a VR headset and controllers to create a database of 162 five-second-long gestures. Next, we ask ten judges to evaluate the quality of gestures in three dimensions, i.e., dynamics, range, and between-hand distance, on a low-medium-high scale with average Fleiss Kappa 0.39 inter-rater agreement. A comparison of various classifiers revealed that the Support Vector Machine (SVM) yielded the best results, achieving classification accuracy of 70-85% for each quality dimension.
dc.affiliationWydział Psychologii w Warszawie
dc.affiliationInstytut Psychologii
dc.affiliationWydział Nauk Humanistycznych w Warszawie
dc.conference2024 IEEE Conference on Virtual Reality and 3D User Interfaces
dc.conference.countryStany Zjednoczone
dc.conference.coverageinternational
dc.conference.datefinish2024-03
dc.conference.datestart2024-03-16
dc.conference.placeOrlando
dc.conference.seriesIEEE Conference on Virtual Reality and 3D User Interfaces
dc.conference.seriesshortcutVR
dc.conference.shortcutVR'24
dc.contributor.authorSkrzek, Tomasz
dc.contributor.authorMalawski, Filip
dc.contributor.authorTadeja, Sławomir K.
dc.contributor.authorHekiert-Małozięć, Daniela
dc.contributor.authorHemmerling, Daria
dc.contributor.authorIgras-Cybulska, Magdalena
dc.date.access2024-06-05
dc.date.accessioned2024-06-05T06:48:47Z
dc.date.available2024-06-05T06:48:47Z
dc.date.created2024-05-29
dc.date.issued2024-05-29
dc.description.accesstimeat_publication
dc.description.physical624-627
dc.description.versionfinal_published
dc.identifier.doi10.1109/VRW62533.2024.00122
dc.identifier.isbn9798350374490
dc.identifier.urihttps://share.swps.edu.pl/handle/swps/702
dc.identifier.weblinkhttps://www.computer.org/csdl/proceedings-article/vrw/2024/744900a624/1Xlc1zuAk8w
dc.languageen
dc.pbn.affiliationpsychologia
dc.publisher.ministerialInstitute of Electrical and Electronics Engineers (IEEE)
dc.relation.book2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
dc.relation.languageen
dc.relation.pages1243
dc.rightsClosedAccess
dc.rights.explanationdostęp zamkniety
dc.rights.questionNo_rights
dc.share.monoOPEN_REPOSITORY
dc.swps.sciencecloudsend
dc.titleAutomatic recognition of gesture qualities in speech delivery in VR - work-in-progress
dc.typeMonographyChapterConference
dspace.entity.typeBook