Browse Prior Art Database

Efficient Wave-Based Web Content Distribution Method

IP.com Disclosure Number: IPCOM000015091D
Original Publication Date: 2002-Apr-26
Included in the Prior Art Database: 2003-Jun-20
Document File: 2 page(s) / 84K

Publishing Venue

IBM

Abstract

Disclosed is a mechanism for scalably and efficiently disseminating web content in a content distribution system. Typically, content is published to a staging server which then becomes the source for all the web servers and caches in the content distribution system; clearly, this solution is not scalable when there are hundreds of nodes in the system. The mechanism described below addresses solves this problem in a scalable manner. Another motivation for solving this problem is that a set of clients may be separated from the staging server by a low-bandwidth Wide Area Network (WAN). Upon receipt of a control message, all these clients would try to pull data from the server across the WAN simultaneously, which affects the performance of the content distribution system significantly. The mechanism outlined achieves scalability by staggering the dissemination of content into multiple waves such that web servers and caches in the first wave pull content directly from the staging server, and nodes in the second wave pull content from a node in the previous wave, and so on.

This text was extracted from a PDF file.
At least one non-text object (such as an image or picture) has been suppressed.
This is the abbreviated version, containing approximately 51% of the total text.

Page 1 of 2

Efficient Wave-Based Web Content Distribution Method

  Disclosed is a mechanism for scalably and efficiently disseminating web content in a content distribution system. Typically, content is published to a staging server which then becomes the source for all the web servers and caches in the content distribution system; clearly, this solution is not scalable when there are hundreds of nodes in the system. The mechanism described below addresses solves this problem in a scalable manner. Another motivation for solving this problem is that a set of clients may be separated from the staging server by a low-bandwidth Wide Area Network (WAN). Upon receipt of a control message, all these clients would try to pull data from the server across the WAN simultaneously, which affects the performance of the content distribution system significantly. The mechanism outlined achieves scalability by staggering the dissemination of content into multiple waves such that web servers and caches in the first wave pull content directly from the staging server, and nodes in the second wave pull content from a node in the previous wave, and so on.

In a content distribution system, web content is disseminated by sending control messages containing a list of files to be pulled from the data servers to the clients. Upon receipt of the control messages, clients pull data from the staging server. Content published onto a staging server in a content distribution (CD) system may have to be disseminated to hundreds of web servers and caches. In such cases, staging servers may be overwhelmed if all web servers and caches make requests to the staging server simultaneously.

In order to ensure scalability, CD clients are partitioned such that each client belongs to one of three waves: clients in the first wave pull data from the staging server, clients in the second wave pull da...