Abstract

(Student: Mohammed Shetaya from German University in Cairo) Due to its potential for collaborative scenarios with actors in different places, remote guidance has become a highly researched field in recent years. With the availability of modern devices and technologies that supports Augmented Reality applications, remote guidance will be an emerging paradigm for the digitization of industrial processes. This thesis aims at studying the applicability of combining video streaming with Augmented Reality and the benefits of the availability of browsers and mobile devices to enable experts from all over the world to guide workers in industrial plants. To apply this, we developed a unity mobile application and a web application. The two applications make use of the WebRTC protocol to send real-time data such as videos. Users can see shared 3D virtual objects, or a remote expert can annotate the rendered view of a worker in the plant from a web browser. The worker can walk around and, perceive precisely where the expert pointed. Due to the open implementation and reference architecture of this work, future research can focus on use cases for remote guidance with convenient tools such as Unity3D and Browser clients. This benefit is proven by an exemplary implementation of a machine learning-based object detection that facilitates the engagement of the expert in the worker’s environment.

Results/Implementation/Project Description

Conclusion

[ PDF (optional) ] 

[ Slides Kickoff/Final (optional)]