A Modular Computer Vision Sonification Model For The Visually Impaired

Show full item record

Please use this identifier to cite or link to this item: http://hdl.handle.net/1853/44401

Title: A Modular Computer Vision Sonification Model For The Visually Impaired
Author: Banf, Michael ; Blanz, Volker
Abstract: This paper presents a Modular Computer Vision Sonification Model which is a general framework for acquisition, exploration and sonification of visual information to support visually impaired people. The model exploits techniques from Computer Vision and aims to convey as much information as possible about the image to the user, including color, edges and what we refer to as Orientation maps and Micro-Textures. We deliberatively focus on low level features to provide a very general image analysis tool. Our sonification approach relies on MIDI using "real-world" instead of synthetic instruments. The goal is to provide direct perceptual access to images or environments actively and in real time. Our system is already in use, at an experimental stage, at a local residential school, helping congenital blind children develop various cognitive abilities such as geometric understanding and spatial sense as well as offering an intuitive approach to colors and textures.
Description: Presented at the 18th International Conference on Auditory Display (ICAD2012) on June 18-21, 2012 in Atlanta, Georgia. Reprinted by permission of the International Community for Auditory Display, http://www.icad.org.
Type: Proceedings
URI: http://hdl.handle.net/1853/44401
ISSN: 2168-5126
Citation: Proceedings of the 18th International Conference on Auditory Display, Atlanta, GA, USA, 18-21 June 2012. Ed. Michael A. Nees, Bruce N. Walker, Jason Freeman. The International Community for Auditory Display, 2012. 121-128.
Date: 2012-06
Contributor: Universität-Gesamthochschule-Siegen. Lehrstuhl Medieninformatik
Relation: ICAD2012. Papers V: Sonification
Publisher: Georgia Institute of Technology
Subject: Auditory display
Sonification of visual information
Visual impairment

All materials in SMARTech are protected under U.S. Copyright Law and all rights are reserved, unless otherwise specifically indicated on or in the materials.

Files in this item

Files Size Format View Description
62-114-2-SP.mp4 28.55Mb MPEG-4 video View/ Open Download Video
62-114-2-SP_streaming.html 932bytes HTML View/ Open Streaming Video
Banf_ICAD2012.pdf 13.62Mb PDF View/ Open Paper

This item appears in the following Collection(s)

Show full item record