Hello, I am a Doctoral candidate at Professor Gudrun Klinker's Augmented Reality chair, having started in May of 2017. I am currently working under a Meta grant, Consider Everyone, where I investigate dark patterns in Augmented Reality usage and how it can adversarially affect privacy and security of bystanders. Previously, I have worked under the Game.UP project in conjunction with the TUM architecture department. I provide topics listed below that you can reach out to me to pursue as a Bachelors, Masters, or a Guided Research. All topics revolve around, but are not limited to, the use of Mixed-Reality systems.
[No Longer Advising - Updated April 16, 2024]
Background: Synchrony is a social phenomenon where people have simultaneous head nods, eye blinks, breathing or even heart beats. I focus on visual detection of such gestures and offer the below topics related to this topic.
- Development of an Online Synchrony Experimental Hub: In this work, I am looking for students to help me design, build, and evaluate an online experimental platform as a part of an open source project to be used by the greater research community to host their own customizable synchrony experiemnts. There are several topics within this bigger topic with some keywords being: Full Stack web development, Avatars, WebAR, Computer Vision, OpenFace, User Design/Studies, React, Python, Open Source Contributions.
- Expanding upon an Initial Synchrony Score: So much goes into synchrony that researchers are still trying to uncover all the relevant parameters. We have created an initial synchrony score as a quantitative indicator of when synchrony is present from the visually detected features of a video stream between pairs of people conversing. I am looking for students who are interested in data science/machine learning, to continue our initial work on evaluating and expanding our synchrony score (to be multi modal or between more than just 2 people) which requires gaining insight or engineering models around continuous data streams. Keywords: TensorFlow, Model Engineering, Streamed Data, User Studies, Pandas, and many other python statistics libraries.
Checkout our github page: https://github.com/TUMFARSynchrony
For interest in these or similar topics, e-mail: eghtebas at in dot tum dot de
Up to Date List of Publications
List of Current & Previous supervised thesis titles:
[ Updated April 16, 2024]
- Current:
- Implementation of Human in the Loop Deployment and Scalable Architecture for an Open Source Video Conferencing Platform (MA'24)
- Empowering Experimenter and Participant Interactions Online | Advanced Customizable Experiments through Full Stack Development and API Design of an Open Source Video Conferencing Platform (MA'24)
- Affective Video Conferencing Platform | Facilitating Human Computer Design Research through scalable architecture and advanced real-time communication analysis (MA'24)
- Increasing Research Reproducability in Online Experiemnts | Exploration, Implementation, and workflow optimization for video conference research platform (MA'24)
- Previous:
- Increasing Robustness of Computer Vision Algorithms in Real-World Conditions through an rPPG Use Case for Cross-Platform Augmented Environments (MA'24)
Enhancement of a Remote Video Conferencing Platform: Integration of Real-Time Feedback and Exploratory Analysis of User Experience (MA'24)
Optimization of Developer Workflow and Implementation of Quality Checks Through Computer Vision for an Open Source Research Platform (MA'24)
Optimization of Video-based Facial Data Extraction for Time-series Correlation Analysis using Distributed-Data Processing Framework (MA'24)
- Intervention by Remote Experts | Guiding Participants in React-based Online Experimental Video Conferencing Platform (MA'24)
AI-Driven Full-Stack Open Source Software Optimization: A Case Study with Experimental Hub (MA'24)
Design and Implementation of User Needs and Interaction Principles for the Sustainability of an Open Source Conferencing Platform to Conduct Remote Experiments (MA'24)
- Next-Generation Video Conferencing Research Platform: Enabling Time Aligned Performance Optimized WebAR Filters across Participants, and Synchrony Score through Full-stack Software Architecture Design (MA'24)
Extending an Open Source Interpersonal Synchrony Research Platform through User Centered Design Evaluations and Frontend Development (MA'23)
Development and Anlaysis of Facial Experssion Filter in an Experimental Hub (GR'23)
- Adapting a Synchrony Score to be Realtime for Online Social XR Experiments (GR'23)
Building an Extendable Research Platform for Conducting Online Synchrony Experiments with the help of Design Thinking and Software Development Life Cycle Concepts (BA'22)
- Analysis of how different lighting conditions affect the performance of a visual heart rate detection algorithm (rPPG) (BA’22)
- Design and Development of an Open-Source Video Streaming Platform for Perceptual Manipulation in Online Synchrony Experiments (BA’22)
- A Machine Learning Exploration to Quantify Synchrony: Visually Detecting Dyadic Synchrony Based on a Multi-model Data Stream (MA’22)
Remotely Measuring Real-time Heart Rate and Smile Synchrony (GR'21)
- A Comparison of Heartbeat measurement over Voice Versus Video (GR'21)
- A calibration Tool to Establish Interpersonal Synchrony Using a Motion-Based Multiplayer WebAR Game (BA'21)
- Quantifying Synchrony in Online Interactions as a Virtual Score and Testing the effect of Varying Emotional Context (MA'21)
- Head nods, smiles and frowns: Measuring how virtual agent can influence decision making by synchronizing with the user in a Social Deduction Game. (BA'21)
- Designing and Deploying a Mediating Conversational Agent to Connect with and Influence Virtual Conference Calls (MA'21)
Augmented Reality Game for Tracking Germs (MA'21)
- Remotely Measuring Physiological Synchronization of Video Conversation (BA'21)
- Virtual Learning Post Pandemic: Design considerations for Mixed Reality Solutions in Education(BA'20)
- Communication in Times of too Much News:Perception of Augmented Voice and Implications for Misinformation (BA'20)
- Exploring Human-Building Interaction:Presenting Initial Frameworks for Home-situated Interactions (BA'20)
Privacy vs. Persuasion: Context-aware Notifications for Urban Planning Projects (BA'20)
- User Perception of Game Elements in Duolingo (GR'20)
- Exploration of Guidelines to Gather Opinion Data from Games within an Urban Planning Context (BA'19)
Engagement in Urban Planning through matching Game Elements and Playertypes (BA'19)
- Psychological Mechanics in Mobile Games and the Shift to Mobile VR (BA'19)
What Urban Planners can Learn from Game Engineers: Artificial Intelligence in Computer Games Applied to Urban Planning Scenarios (BA'19)
Interactive Calibration of the Microsoft HoloLens (GR'19)
Augmented Reality Audio: The social acceptance of large scale building projects in urban areas with a special focus on the spatial noise pollution (BA'18)
