Team for Research in
Ubiquitous Secure Technology

Optimal Resource Utilization in Content Distribution Networks
Yee Jiun Song, Venugopalan Ramasubramanian and Emin Gun Sirer

Citation
Yee Jiun Song, Venugopalan Ramasubramanian and Emin Gun Sirer. "Optimal Resource Utilization in Content Distribution Networks". Technical report, Cornell University, TR2005-2004, November, 2005.

Abstract
This paper examines replication in content distribution networks and proposes a novel mechanism for optimally resolving performance versus cost tradeoffs. The key insight behind our work is to formally and analytically capture the relationship between performance, bandwidth overhead and storage requirements for a web cache, express the system goals as a mathematical optimization problem, and solve for the optimal extent of replication that achieves the desired system goals with minimal overhead. We describe the design and implementation of a new content distribution network based on this concept, called CobWeb. CobWeb can achieve a target lookup latency while minimizing network and storage overhead, minimize access time while keeping bandwidth usage below a set limit, and alleviate “flash crowd” effects by rapidly replicating popular objects through fast and highly adaptive replica management. We outline the architecture of the CobWeb system, describe its novel optimization algorithm for intelligent resource allocation, and compare, through simulations and a physical deployment on PlanetLab, CobWeb’s informed, analysis-driven replication strategy to existing approaches based on passive caching and heuristics.

Electronic downloads

Citation formats  
  • HTML
    Yee Jiun Song, Venugopalan Ramasubramanian and Emin Gun
    Sirer. <a
    href="http://www.truststc.org/pubs/41.html"
    ><i>Optimal Resource Utilization in Content
    Distribution Networks</i></a>, Technical report,
     Cornell University, TR2005-2004, November, 2005.
  • Plain text
    Yee Jiun Song, Venugopalan Ramasubramanian and Emin Gun
    Sirer. "Optimal Resource Utilization in Content
    Distribution Networks". Technical report,  Cornell
    University, TR2005-2004, November, 2005.
  • BibTeX
    @techreport{SongRamasubramanianSirer05_OptimalResourceUtilizationInContentDistributionNetworks,
        author = {Yee Jiun Song, Venugopalan Ramasubramanian and
                  Emin Gun Sirer},
        title = {Optimal Resource Utilization in Content
                  Distribution Networks},
        institution = {Cornell University},
        number = {TR2005-2004},
        month = {November},
        year = {2005},
        abstract = {This paper examines replication in content
                  distribution networks and proposes a novel
                  mechanism for optimally resolving performance
                  versus cost tradeoffs. The key insight behind our
                  work is to formally and analytically capture the
                  relationship between performance, bandwidth
                  overhead and storage requirements for a web cache,
                  express the system goals as a mathematical
                  optimization problem, and solve for the optimal
                  extent of replication that achieves the desired
                  system goals with minimal overhead. We describe
                  the design and implementation of a new content
                  distribution network based on this concept, called
                  CobWeb. CobWeb can achieve a target lookup latency
                  while minimizing network and storage overhead,
                  minimize access time while keeping bandwidth usage
                  below a set limit, and alleviate “flash crowd”
                  effects by rapidly replicating popular objects
                  through fast and highly adaptive replica
                  management. We outline the architecture of the
                  CobWeb system, describe its novel optimization
                  algorithm for intelligent resource allocation, and
                  compare, through simulations and a physical
                  deployment on PlanetLab, CobWeb’s informed,
                  analysis-driven replication strategy to existing
                  approaches based on passive caching and heuristics.},
        URL = {http://www.truststc.org/pubs/41.html}
    }
    

Posted by Bill Hogan on 4 Apr 2006.
For additional information, see the Publications FAQ or contact webmaster at www truststc org.

Notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright.