The goal of the E-Inclusion Research Network is to conduct a network of end-users, artists, producers and researchers who will develop powerful audio-video tools and methodologies that will allow multimedia content producers to improve the richness of the multimedia experience for people with vision loss and hearing loss by automating key aspects of the multimedia production and post-production processes. This project is financed partly by Canadian Heritage.
The expertise of the network researchers in speech recognition, audio processing, descriptive video, automatic audio-visual content extraction, human factors and human-machine interaction will be applied to produce descriptive video for the visually-impaired and captioned imagery for the hearing-impaired of Canadian cultural content. Research is grouped under three themes:
- Audio-Visual Content Extraction & Interaction:
This theme aims
at developing software tools for the automatic extraction of audio-visual
content in video documents and the world around us to facilitate:
- content accessibility to hard of seeing and hearing people;
- audio-visual indexing;
- computer-assisted and adaptable interactive video description.
- Speech & Audio Context Recognition:This theme will use Speech and Audio Context Recognition to address the automation of labour-intensive aspects of media production and post-production, such as audio post-synchronization, captioning, script correction, and subtitling.