This paper presents a novel application of natural interaction techniques for technical documentation navigation in augmented reality maintenance. The objective is to provide technical information where and when needed in order to reduce the time spent in retrieving procedural data from manuals. The system integrates a video and depth camera for user gesture acquisition, a webcam for marker-based tracking and a see through head mounted display for digital information overlay. We designed a novel hand free gesture-based interface to access technical documentation while performing maintenance tasks. We implemented a specific flexible system to prototype natural interfaces using UML configurable state machines. It supports 2D and 3D content navigation, CAD assembly explosion, real time 3D sectioning and operation browsing. We differentiate the interaction metaphors for 2D documents and 3D CAD models in order to be intuitive and easy to learn. A case study and a user test demonstrated the feasibility and the good acceptance of the presented gesture interface.

Natural interaction for online documentation in industrial maintenance / Fiorentino, Michele; Uva, Antonio Emmanuele; Monno, Giuseppe; Radkowski, Rafael. - In: INTERNATIONAL JOURNAL OF COMPUTER AIDED ENGINEERING AND TECHNOLOGY. - ISSN 1757-2657. - STAMPA. - 8:1-2(2016), pp. 56-79. [10.1504/IJCAET.2016.073269]

Natural interaction for online documentation in industrial maintenance

FIORENTINO, Michele;UVA, Antonio Emmanuele;MONNO, Giuseppe;
2016-01-01

Abstract

This paper presents a novel application of natural interaction techniques for technical documentation navigation in augmented reality maintenance. The objective is to provide technical information where and when needed in order to reduce the time spent in retrieving procedural data from manuals. The system integrates a video and depth camera for user gesture acquisition, a webcam for marker-based tracking and a see through head mounted display for digital information overlay. We designed a novel hand free gesture-based interface to access technical documentation while performing maintenance tasks. We implemented a specific flexible system to prototype natural interfaces using UML configurable state machines. It supports 2D and 3D content navigation, CAD assembly explosion, real time 3D sectioning and operation browsing. We differentiate the interaction metaphors for 2D documents and 3D CAD models in order to be intuitive and easy to learn. A case study and a user test demonstrated the feasibility and the good acceptance of the presented gesture interface.
2016
Natural interaction for online documentation in industrial maintenance / Fiorentino, Michele; Uva, Antonio Emmanuele; Monno, Giuseppe; Radkowski, Rafael. - In: INTERNATIONAL JOURNAL OF COMPUTER AIDED ENGINEERING AND TECHNOLOGY. - ISSN 1757-2657. - STAMPA. - 8:1-2(2016), pp. 56-79. [10.1504/IJCAET.2016.073269]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11589/90786
Citazioni
  • Scopus 12
  • ???jsp.display-item.citation.isi??? ND
social impact