Show simple item record

dc.contributor.advisorPu, Calton
dc.contributor.authorWang, Qingyang
dc.date.accessioned2015-09-21T15:52:19Z
dc.date.available2015-09-22T05:30:06Z
dc.date.created2014-08
dc.date.issued2014-06-27
dc.date.submittedAugust 2014
dc.identifier.urihttp://hdl.handle.net/1853/54002
dc.description.abstractAn essential requirement of cloud computing or data centers is to simultaneously achieve good performance and high utilization for cost efficiency. High utilization through virtualization and hardware resource sharing is critical for both cloud providers and cloud consumers to reduce management and infrastructure costs (e.g., energy cost, hardware cost) and to increase cost-efficiency. Unfortunately, achieving good performance (e.g., low latency) for web applications at high resource utilization remains an elusive goal. Both practitioners and researchers have experienced the latency long-tail problem in clouds during periods of even moderate utilization (e.g., 50%). In this dissertation, we show that transient bottlenecks are an important contributing factor to the latency long-tail problem. Transient bottlenecks are bottlenecks with a short lifespan on the order of tens of milliseconds. Though short-lived, transient bottleneck can cause a long-tail response time distribution that spans a spectrum of 2 to 3 orders of magnitude, from tens of milliseconds to tens of seconds, due to the queuing effect propagation and amplification caused by complex inter-tier resource dependencies in the system. Transient bottlenecks can arise from a wide range of factors at different system layers. For example, we have identified transient bottlenecks caused by CPU dynamic voltage and frequency scaling (DVFS) control at the CPU architecture layer, Java garbage collection (GC) at the system software layer, and virtual machine (VM) consolidation at the application layer. These factors interact with naturally bursty workloads from clients, often leading to transient bottlenecks that cause overall performance degradation even if all the system resources are far from being saturated (e.g., less than 50%). By combining fine-grained monitoring tools and a sophisticated analytical method to generate and analyze monitoring data, we are able to detect and study transient bottlenecks in a systematic way.
dc.format.mimetypeapplication/pdf
dc.language.isoen_US
dc.publisherGeorgia Institute of Technology
dc.subjectPerformance
dc.subjectDistributed systems
dc.subjectLong-tail
dc.subjectMulti-tier
dc.subjectWeb applications
dc.subjectScalability
dc.subjectCloud computing
dc.titleA study of transient bottlenecks: understanding and reducing latency long-tail problem in n-tier web applications
dc.typeDissertation
dc.description.degreePh.D.
dc.contributor.departmentComputer Science
dc.embargo.terms2015-08-01
thesis.degree.levelDoctoral
dc.contributor.committeeMemberLiu, Ling
dc.contributor.committeeMemberSchwan, Karsten
dc.contributor.committeeMemberAhamad, Mustaque
dc.contributor.committeeMemberNavathe, Shamkant
dc.contributor.committeeMemberBlough, Douglas
dc.date.updated2015-09-21T15:52:19Z


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record