Adaptive Load Shedding for Windowed Stream Joins
Yu, Philip S.
MetadataShow full item record
We present an adaptive load shedding approach for windowed stream joins. In contrast to the conventional approach of dropping tuples from the input streams, we explore the concept of selective processing for load shedding, focusing on costly stream joins such as those over set-valued or weighted set-valued attributes. The main idea of our adaptive load shedding approach is two-fold. First, we allow stream tuples to be stored in the windows and shed excessive CPU load by performing the stream join operations, not on the entire set of tuples within the windows, but on a dynamically changing subset of tuples that are highly beneficial. Second, we support such dynamic selective processing through three forms of runtime adaptations: By adaptation to input stream rates, we perform partial processing based load shedding and dynamically determine the fraction of the windows to be processed by comparing the tuple consumption rate of join operation to the incoming stream rates. By adaptation to time correlation between the streams, we dynamically determine the number of basic windows to be used and prioritize the tuples for selective processing, encouraging CPU-limited execution of stream joins in high priority basic windows. By adaptation to join directions, we dynamically determine the most beneficial direction to perform stream joins in order to process more useful tuples under heavy load conditions and boost the utility or number of output tuples produced. Our load shedding framework not only enables us to integrate utility-based load shedding with time correlation-based load shedding, but more importantly, it also allows load shedding to be adaptive to various dynamic stream properties. Inverted indexes are used to further speed up the execution of stream joins based on set-valued attributes. Experiments are conducted to evaluate the effectiveness of our adaptive load shedding approach in terms of output rate and utility.
- CERCS Technical Reports 
Showing items related by title, author, creator and subject.
The feasibility of thermal destruction of chlorine-containing concentrated streams from closed cycle processes. Phase 2- Inclusion of concentrate in black liquor stream. Project 3671-1, 3671-2, 3534-47, final report a progress report to National Council for Air and Stream Improvement, Weyerhaeuser Company, and the member companies of the Institute of Paper Science and Technology Nichols, Kenneth M.; Sonnenberg, Lucinda B. (Atlanta, GA : the Institute,Georgia Institute of Technology, 1992-06-23)
Assessment of in-stream processes in urban streams for development of sediment total maximum daily load Robinson, Joshua Lee (Georgia Institute of Technology, 2005-01-17)The Clean Water Act requires the establishment of Total Maximum Daily Loads (TMDLs) for quantifying allowable pollutant loads for stream reaches in which the biological integrity of the stream is threatened. Sediment TMDLs ...
Kuacharoen, Pramote (Georgia Institute of Technology, 2004-04-12)Downloading software from a server usually takes a noticeable amount of time, that is, noticeable to the user who wants to run the program. However, this issue can be mitigated by the use of streaming software. Software ...