Flow: A live captioning system for dysarthric speech

In recent years, video conferencing has become a popular communication channel. However, for people with Parkinson’s disease, speech problems like stutters, gaps, and ticks can quickly derail a conversation and render video communication services unusable. Live captioning can be very helpful, but only if the captions have sufficient quality. To facilitate communication, we propose to build a live captioning system for Parkinson’s patients called Flow. Our work is based on an existing prototype captioning system, which we customize for Parkinson’s patients’ speech. Specifically, we collect anonymous speech recordings by Parkinson’s patients and use the recordings to customize the system for Parkinson’s patients.

Faculty Supervisor:

Miikka Silfverberg;Jian Zhu

Student:

Partner:

Skyline Innovation

Discipline:

Computer science

Sector:

Information and cultural industries

University:

The University of British Columbia

Program: