Worker assistance system

The Worker Assistance System is a set of new libraries and applications designed to guide workers in manual assembly processes, thereby reducing the time required for worker education. The system employs a JSON-based instruction list, or work plan, which serves as its primary input. Composed of several software modules, the assistance system includes a speech-recognition based MQTT message provider, a data glove adapter, a video viewer, and a 3D instruction viewer. . Other supporting assistance systems can be easily integrated.

The voice recognition is a separate processing tool can be configured for the commands, that will be trained. It is loosely coupled with different assistance systems by means of MQTT. In principles also other post processing tools can be used. The voice recognition can run on side on embedded notes, so security aspects can be addressed.

• highly configurable and adaptable to other purposes (e.g. machine control) and industrial domains
• based on Python programming language
• supports MQTT, which is a widely adopted communication technology in industries

The source code is portable and can be adapted to different computer systems based on different HW platforms or operating systems. Documentation consists of an instruction list and a set of pictures and video sequences of tools, materials and working steps.

People who need assistance without any interruption of his working process especially in industrial domains with manual assembly processes

Open source (MIT License) of basic functionality (speech recognition), support of systems integrators and customizing the tool