TY  - GEN
Y1  - 2024/10/11/
AV  - public
N2  - Automated biomechanical testing has great potential for the development of VR applications, as initial insights into user behaviour can be gained in silico early in the design process. In particular, it allows prediction of user movements and ergonomic variables, such as fatigue, prior to conducting user studies. However, there is a fundamental disconnect between simulators hosting state-of-the-art biomechanical user models and simulators used to develop and run VR applications. Existing user simulators often struggle to capture the intricacies of real-world VR applications, reducing ecological validity of user predictions. In this paper, we introduce sim2vr, a system that aligns user simulation with a given VR application by establishing a continuous closed loop between the two processes. This, for the first time, enables training simulated users directly in the same VR application that real users interact with. We demonstrate that sim2vr can predict differences in user performance, ergonomics and strategies in a fast-paced, dynamic arcade game. In order to expand the scope of automated biomechanical testing beyond simple visuomotor tasks, advances in cognitive models and reward function design will be needed.
KW  - Biomechanical simulation
KW  -  interaction design
KW  -  VR simulation alignment
KW  -  automated testing
KW  -  virtual reality
KW  -  VR development
KW  -  VR application
KW  -  deep reinforcement learning.
N1  - A.I. received funding from the Academy of Finland Flagship programme ?Finnish Center for Artifcial Intelligence? (FCAI). P.H. has
been supported by the European Commission through the Horizon
2020 FET Proactive program (grant agreement 101017779). R.M.S.
and M.K. received funding from the DIFAI ERC Advanced Grant
(proposal 101097708, funded by the UK Horizon guarantee scheme
as EPSRC project EP/Y029178/1). R.M.S. also received funding from
EPSRC projects EP/T00097X/1, EP/R018634/1, and EP/T021020/1.
A.O. was funded by Research Council of Finland (grant no. 357578)
and ERC (grant no. 101141916).
SN  - 9798400706288
TI  - SIM2VR: Towards Automated Biomechanical Testing in VR
A1  - Fischer, Florian
A1  - Ikkala, Aleksi
A1  - Klar, Markus
A1  - Fleig, Arthur
A1  - Bachinski, Miroslav
A1  - Murray-Smith, Roderick
A1  - Hämäläinen, Perttu
A1  - Oulasvirta, Antti
A1  - Müller, Jörg
UR  - https://eprints.gla.ac.uk/335142/
ID  - enlighten335142
ER  -