Low-cost Intelligent Mixed Reality System for Responsive Human-Machine Interactions

Notwithstanding scenarios predicting their obsolescence in some human-machine contexts, humans and their abilities are critically important parts of industrial systems across a wide range of industries.

This is due to human's unmatched multi-dextrous and adaptable abilities to perform physical and cognitive tasks. Our project picks up on this issue by investigating the solution potential of Mixed Reality-based (MR) Operator Assistance Systems (OAS).

MR-based OAS are interactive systems that promise to close the gap between operational demands and worker's abilities by collecting, processing and disseminating relevant information. Our long-term research ambition is the development of a low-cost MR system that is able to autonomously guide un- and semi-skilled operators to perform essential human-machine processes, while simultaneously sensing and reacting to the shop floor context and humans' abilities and actions.

The project’s aims are to develop an MR system that is able to guide operators how to complete a task, sense where it needs to be completed, and assess if a task has been completed correctly.