Investigating the Effects of Emotion on Visuo-Somatosensory Integration by Using an AI-Powered Markerless Motion Capture System

We use all forms of sensory information when directing our movements to ensure that we reach our target. Conversely, when we have conflicting tactile and visual streams of information, like shaving in the mirror, the brain tends to inhibit the tactile information in order to favour our visual information. However the extent to which this is observed, based on our emotional response to the tactile sensation, is not understood. We plan to build an AI-powered markerless motion capture model (MMC) to track a goal-directed movement across pleasant and unpleasant surfaces, while analyzing electroencephalography (EEG) to investigate how the brain responds. By bringing our AI experience to the host institution, we hope to leave behind accessibility to motion capture technology through a pipeline and AI-powered MMC model that they are able to use for further research. The host institution has also offered a course as well as training with utilizing EEG technology, which will be utilized in conjunction with the results of this project, for further research projects and an undergraduate thesis at the home institution.

Faculty Supervisor:

Gerome Mansion

Student:

Partner:

Aix-Marseille Université

Discipline:

Physics

Sector:

Education

University:

Queen's University

Program: