Lukas Schneidt
Supervisor:Prof. Gudrun Klinker
Advisor:Sven Liedtke
Submission Date:15.03.2020


Having to look at sheet music while playing a new piece of music on the piano can be very tiring and slows down the overall learning process and motivation of the student. The representation of sheet music as we know it today has been invented hundreds of years ago and has not changed a lot ever since, despite the increase in technological possibilities. Augmented Reality (AR), being one of them, offers a natural way of assisting the user by scanning the environment and adding virtual supplements to their real perception. The goal of this thesis is to develop an augmented reality application for the head-mounted display Magic Leap 1, which offers a way to make it easier to learn new pieces of music or techniques. Highlighting specific properties of the keyboard concerning a specified key, or indicating which key should be played next can be a helpful asset. The application was implemented for the use with a MIDI keyboard and has been implemented using Unity3D. It was evaluated in terms of intuitiveness and usability, and it has been found that the AR piano instructor could generate interest in music theory, and it also motivated the user to learn to play the piano.

Results/Implementation/Project Description


[ Slides Kickoff/Final (optional)]