Abstract

With the digitalization trend, we have been witnessing the fourth industrial revolution, "Industry 4.0". One of its features is "Digital Twin", the digital representations of the physical assets, processes or systems. The motivation for this thesis can be found from the challenges of designing a human-machine interface (HMI) to handle and visualize the increasing amount of data brought by the increasing digital twin applications in the real industry environment. The work, therefore, targets on defining and prototyping an innovative HMI proof-of-concept (POC) leveraging state-of-the-art mixed reality (MR) technologies, to enhance the operation of a digital twin based smart crane "Ilmatar" as a case study. In this application context, the work firstly determines the hardware and software setup, then designs and implements the POC prototype, an MR application consisting of visualization, interaction, communication and registration modules. Those modules enable the application to function as a bridge of information exchange between the crane's digital twin platform through the crane GraphQL server and the user through the HoloLens interface, both in a bi-directional manner. In one direction, crane data is handled and displayed in a virtual dashboard in front of the users' view for monitoring; In the other direction, users can interact and navigate the crane via different methods, i.e. fixed and movable target control, with high flexibility empowered by spatial tracking and registration.

Results/Implementation/Project Description

Conclusion

[ PDF (optional) ] 

[ Slides Kickoff/Final (optional)]