Abstract

The goal of these bachelor’s theses is a user interface system for Augmented and Virtual Reality environments which allows an automated mapping and adjusting of user interfaces to different Augmented and Virtual Reality devices. This includes display of and interaction with user interfaces in 3D space. Therefore, guidelines of existing interaction techniques and user interfaces in two- and three-dimensional environments were analyzed. Using the gathered information, a basic concept for a user interface system was developed. A demonstrative implementation of this concept was made in Unity3D for Microsoft HoloLens, Meta 2, HTC Vive and Oculus Rift.

The purpose of the system is to simplify the implementation and management of user interfaces for Augmented and Virtual Reality devices in a development environment. Due to similar requirements and technology, the topic was observed both from the Augmented and Virtual Reality perspective.

Results

• User interface system for Augmented and Virtual Reality environments

• Automated mapping and adjusting of user interfaces to different devices

• Includes display of and interaction with user interfaces in 3D space

• Basic concept for a user interface system

→ Demonstrative implementations:

Interaction at-a-distance in Virtual Reality with a display-fixed menu (HTC Vive & Oculus Rift)

Local interaction in Virtual Reality (HTC Vive & Oculus Rift)

Interaction using the Meta 2

Interaction using the HoloLens:

(a) Button selection

(b) Confirmation and button press by using gestures

(c) UI outside field of view

(d) UI moves into field of view

Conclusion

• Similarities between Augmented and Virtual Reality devices

• Utilizing the extensive existing research and example implementations a general concept was developed

• Make it easier for new developers to create interfaces for multiple Augmented and Virtual Reality devices

• Improvement of general software support for Augmented and Virtual Reality devices

Final Presentation Slides