Worker Assistance

The scenario „Comprehensive Worker Assistance“ consists of scenarios that make use of mobile mixed reality (MR) systems to support manual work tasks. Workers use mobile mixed reality systems such as data glasses, tablet pcs or mobile projectors to merge real and virtual data in real time. These MR systems are designed in a way that they do not have a negative influence on primary work tasks but help to reduce secondary work tasks (e.g. to gather information).  

A comprehensive scenario was defined for evaluation of common requirements and services:  

  • The main requirement is the mobility of the user while visualizing situationally suitable information. Commonly used services are referencing / tracking, calibration, visualization, interaction / workflow.  
  • Therefore a major task here is the analysis of how to connect and interchange different tracking systems of different work principles (inside-out, outside-in, with and without fiducial markers, etc.) by making use of the ARVIDA reference architecture. Each partner shall be able to use its standard visualization tools under comprehensive conditions (e.g. calibration) and be able to connect to the tracking system.  

Reference Architecture

Technologies connected by the ARVIDA reference architecture are used within this scenario. These technologies are:

  • Tracking
  • Rendering / Visualization
  • Mobile Displays and Projection
  • Data connection  

The requirements regarding quality of the virtual data is usually lower than in other applications. The reason is that visual impression usually is less important than in other scenarios. The correct spatial and temporal presentation of the content is one of the main challenges for the systems because latency between real and virtual world are not tolerable with data glasses or projectors.

Included Scenarios

The comprehensive scenario consists of three applications: „MR‐Engineering“ (TKMS), „Mobile projection based assistance systems“ (Volkswagen AG) and „Servicing and Training“ (Volkswagen AG). All share the use of the ARVIDA reference architecture. They make use of different connected services developed within the project.

The situationally suitable information presentation of complex information on mobile displays is the main focus of the scenario TP 3.3.3 „MR‐Engineering“ (TKMS). Information on work steps is presented within field of sight without the need to gather that information from 2D or 3D sketches.  

The “Mobile projection based assistance systems” (TP 3.3.4, Volkswagen AG) put emphasis on use of mobile projectors to support workers. A very high spatial precision is necessary so that within this scenario 2D fiducials can be used in addition to markerless tracking.  

In scenario TP 3.3.5 “Servicing and Training” the potential of the reference architecture for providing augmented reality information in servicing and training is being researched. It makes use of the reference architecture by enabling the used systems switch between visualization media and tracking with low effort.