URL switching at gigabit speeds
Problem
Gigabit speed networks are increasingly being used to carry Web traffic.
With Web sites becoming distributed, a single URL can refer to content at
multiple physical destinations - each destination a content server (whether the
origin server or a cache). Given the very large number and dynamic nature of
URLs, what are the best methods to make forwarding decisions for Web traffic?
How can these forwarding decisions best be incorporated into gigabit switch
architectures?
Objective
Our objectives are to study methods for making forwarding decisions based on
application-layer (HTTP) criteria. We will study methods of compressing URL
information at a content provider and using the compressed form for making
switching decisions.
Work completed
We have demonstrated that URL directory lists can be "compressed" using
signatures. Such compressed URL lists require less network resources for
sharing (e.g., between URL routers). The compressed form of the URLs
also enables high-speed switch mechanisms that are not possible given
full URLs. We have studied MD5, CRC, checksum, and Bloom filter
compression methods. We have also studied hashing methods for fast look-up.
A new "aggressive hashing" algorithm has been proposed and shown to be
faster in look-up time than existing hashing algorithms.
Work in progress
None. This part of the project is complete.
Results
One PhD student (Zornitza Genova Prodanoff - see the
people page) has finished with this topic as her
dissertation work. The following papers and letters have been published:
This material is based upon work supported by the National Science
Foundation under grant No. 9875177. Any opinions, findings and conclusions or
recommendations expressed in this material are those of the author and do not
necessarily reflects the views of the National Science Foundation (NSF).
Last updated by
Ken Christensen on DECEMBER 20, 2003