Sketch Input for Interactive Component Recognition on Mobile Devices

For both aircraft assembly and maintenance, mechanics need to quickly access information about parts and determine part numbers. Part numbers can be retrieved from 3D models of the aircraft but locating such models within an airplane is very difficult, particularly on small mobile devices. An additional complication is that the objects to be recognized are often embedded with a larger assembly structure which can obscure portions of the objects. Our aim is to develop a prototype system that incorporates new methods to aid in the maintenance of complex machinery by utilizing the input/output feature-set of modern mobile touchscreen devices. We will develop a real-time recognition system of physical components using captured images. User interaction will include touchscreen sketching for augmenting portions of occluded components to improve recognition rates. In addition, the system will offer limited Augmented Reality tagging of components, providing a visual link to reference manuals describing the component………………………………….

Faculty Supervisor:

Stephen Brooks

Student:

Partner:

Boeing Vancouver (Richmond, BC);Dalhousie University

Discipline:

Computer science

Sector:

University:

Dalhousie University

Program:

Accelerate