Active management of Cache resources

Show full item record

Please use this identifier to cite or link to this item: http://hdl.handle.net/1853/24663

Title: Active management of Cache resources
Author: Ramaswamy, Subramanian
Abstract: This dissertation addresses two sets of challenges facing processor design as the industry enters the deep sub-micron region of semiconductor design. The first set of challenges relates to the memory bottleneck. As the focus shifts from scaling processor frequency to scaling the number of cores, performance growth demands increasing die area. Scaling the number of cores also places a concurrent area demand in the form of larger caches. While on-chip caches occupy 50-60% of area and consume 20-30% of energy expended on-chip, their performance and energy efficiencies are less than 15% and 1% respectively for a range of benchmarks! The second set of challenges is posed by transistor leakage and process variation (inter-die and intra-die) at future technology nodes. Leakage power is anticipated to increase exponentially and sharply lower defect-free yield with successive technology generations. For performance scaling to continue, cache efficiencies have to improve significantly. This thesis proposes and evaluates a broad family of such improvements. This dissertation first contributes a model for cache efficiencies and finds them to be extremely low - performance efficiencies less than 15% and energy efficiencies in the order of 1%. Studying the sources of inefficiency leads to a framework for efficiency improvement based on two interrelated strategies. The approach for improving energy efficiency primarily relies on sizing the cache to match the application memory footprint during a program phase while powering down all remaining cache sets. Importantly, the sized is fully functional with no references to inactive sets. Improving performance efficiency primarily relies on cache shaping, i.e., changing the placement function and thereby the manner in which memory shares the cache. Sizing and shaping are applied at different phase of the design cycle: i) post-manufacturing & offline, ii) at compile-time, and at iii) run-time. This thesis proposes and explores techniques at each phase collectively realizing a repertoire of techniques for future memory system designers. The techniques use a combination of HW-SW techniques and are demonstrated to provide substantive improvements with modest overheads.
Type: Dissertation
URI: http://hdl.handle.net/1853/24663
Date: 2008-07-08
Publisher: Georgia Institute of Technology
Subject: Efficiency
Customized placement
Reconfigurable caches
Customized caches
Efficient caches
Cache memory
Memory management (Computer science)
Energy conservation
Department: Electrical and Computer Engineering
Advisor: Committee Chair: Yalamanchili, Sudhakar; Committee Member: Davis, Jeffrey; Committee Member: Ramachandran, Umakishore; Committee Member: Schimmel, David; Committee Member: Wardi, Yorai
Degree: Ph.D.

All materials in SMARTech are protected under U.S. Copyright Law and all rights are reserved, unless otherwise specifically indicated on or in the materials.

Files in this item

Files Size Format View
ramaswamy_subramanian_200808_phd.pdf 1.061Mb PDF View/ Open

This item appears in the following Collection(s)

Show full item record