Ad-hoc worker assistance

When assistance is needed at the assembly line, swift and timely support is crucial to prevent delays. The ad-hoc worker assistance mobile software aims to connect workers at the assembly line with supervisors/planners in case assistance is needed in an easy and effective way. The assistance is established using a 1-on-1 video call, supported by augmented reality techniques: The rear camera of the worker's smartphone or tablet is transmitted to the expert, who can not only instruct the worker by speech, but also place persistent 3D hints, arrows and drawings directly into the video.

Video-based 1-on-1 calls can be established with the use of Augmented Reality techniques. Using the rear camera of the smartphone or tablet, the worker can scan the environment. In it, the tool recognizes surfaces which are transmitted along the video stream. The expert can then place 3D content (highlights, arrowsa and drawings) onto the surfaces to create persistent 3D information for the worker. Along with this main feature, a set of additional functions were realized: A text chat can be used in noisy environments. If the expert uses the desktop version of the tool, the screen can be shared to show documents during the call. Also asynchronous document sharing is possible.

The tool is currenlty realized as a smartphone and tablet app for Android and iOS. A desktop version for experts is available for Microsoft Windows.

The ad-hoc worker assistance tool aims to support in all scenarios where timely and swift assistance is beneficial. Especially when workers and supervisors/planners are not located in the same location, delays can be prevented. Daimler Truck is testing the prototype within the project and aims to further investigate a broader use.

The ad-hoc worker assistance will be integrated in Raumtänzer's service toolchain which will be available as a software-as-a-service product.