Development of automatic sound-visualized caption across cultural backgrounds

This project aims to benefit society by improving accessibility for viewers who may not be able to receive sound information well from the media content, including DHH viewers. To develop and research for the project, it is necessary to reflect an in-depth and multi-faceted case analysis on the topic of improving sound accessibility. To fulfil these needs, I will collaborate with researchers at the University of Toronto for about 18 weeks on technology development. Furthermore, we can conduct surveys and workshops for various users, such as deaf people in Canada or North America, and have in-depth research discussions with collaborating researchers to successfully carry out the project. The participant researcher will have the opportunity through this project to 1) research and analyze sound-visualized captions to improve and advance user-centred multimodal interaction and accessibility, 2) develop technologies to enhance users’ immersion and viewing experience of media contents, and 3) expand the networking in DGP lab at University of Toronto.

Faculty Supervisor:

Khai N. Truong

Student:

Partner:

Gwangju Institute of Science and Technology

Discipline:

Computer science

Sector:

Artificial Intelligence; Information and Communications Technology; New and Digital Media

University:

University of Toronto

Program: