Design and Implementation of a Virtual Reality Experience System Incorporating Popular Music and Dance

Abstract

In this paper, we introduce a design of immersive virtual reality system that combines pop music and dance to attract the user and bring them the entertainment experiences. Using motion capture, real time audio analysis, and 3D visualization, the proposed approach generates an interactive scenario in which users learn, perform, and experience dance choreography to pop music. The system architecture is based on the Unity3D game engine and the Oculus Quest 2 VR headset, combined with in-house motion tracking algorithms to offer a dynamic and fun experience. We investigated learnability, immersion, and learning effectiveness through two user studies involving three age groups with 45 participants in total. The VR dance app scored 78.4 on average in the SUS. The74% of respondents reported to have improved significantly in dancing, and 83% to feel they were performing better. The system latency was limited to less than 20ms to maintain synchronization of user’s movement and feedback in the virtual world. This work advances the development of VR-based entertainment and education, and establishes that music and dance may be leveraged as sources of fun and learning in virtual worlds.