Web Server Benchmark Announced

Is the Web coming of age?

The Standard Performance Evaluation Corp. (SPEC) of Manassas, VA, has announced the first standardized benchmark for measuring the performance of World Wide Web servers. Called SPECweb96, it was developed by the company's Open Systems Group (OSG), together with vendors and research organizations, including CommerceNet, DEC, HP, IBM, Intel, Netscape Communications, and Sun Microsystems. According to SPEC, SPECweb96 is designed for system and software vendors and customers seeking performance data to help them in making informed Web server purchases. SPEC is a nonprofit corporation established to set up, maintain and endorse a standardized set of relevant benchmarks applicable to high-performance computer systems.

The initial release focuses on server performance for static Web pages, measuring the ability to service HTTP requests. SPECweb96 uses one or more clients to send the HTTP requests to the server, and the software then measures the response time for each request. At the end of a run, it calculates a metric based on overall throughput measured as maximum benchmark operations per second. Initial SPECweb96 results are currently available on SPEC's Web site (http://www.specbench.org/osg/web96/), and the software will have its public release by the end of August.

According to a company spokesperson, the SPECweb96 workload simulates the accesses to a Web service provider where the server supports the home pages of several different organizations. The workload is based on analyses of server logs from a variety of popular Internet servers, as well as some smaller sites. To further validate the workload, data from the analyses was compared to logs from Netscape and CommerceNet.

Perhaps the most interesting aspect of this development is the fact of its having happened at all, which indicates that the Internet and Web-related technologies and products are reaching new levels of maturity that require this kind of benchmarking. We will continue to watch for further developments in the field.