Extended Abstract: Using Vocal-Based Sounds to Represent Sentiment in Complex Event Processing
MetadataShow full item record
There is an intricate and evolving relationship between sonification and Complex Event Processing (CEP) for improved situational awareness. In a paper presented at ICAD 2013 , we introduced a series of techniques using CEP for simultaneous sonification of both quantitative “hard” data and human-derived “soft” data in the context of assistive technology. The connection of CEP and sonification was explored further in the context of a severe weather tracker that relies on fusion of quantitative (sensor-based) weather data along with human observations about storms and related conditions . An area of shortcoming in both of these earlier works was the difficulty in creating sounds that represented human sentiment about observed conditions (e.g. unanticipated obstacles for a blind person crossing a busy street, or impending dangerous weather conditions) in a format that enabled intuitive listening for improved situational awareness. This extended abstract provides an update on that continuing research by representing human sentiment data, via the use of vocal synthesis that is driven by Complex Event Processing.