Quantcast
You are not logged in, click here to log in.

This Question is Possibly Answered

1 "correct" answer available (4 pts) 2 "helpful" answers available (2 pts)
1 Replies Last post: Dec 2, 2008 1:54 PM by JamesM  
Click to view spockcat's profile New Member 1 posts since
Nov 15, 2008
Reply

Nov 15, 2008 3:41 PM

Worldbench numbers??

I was looking at several of laptop reviews on this site to consider a purchase
and I had a question concerning the Lab Test section and the Worldbench
numbers.

The raw Worldbench numbers are defined as seconds. I assume that this
is the number of seconds to complete a specific task. Therefore,
higher numbers would be slower performance. However, looking at these
three reviews, the laptop with the higher raw scores was given a higher
overall performance score.

http://www.pcworld.com/reviews/product/31948/tests/wind_nb_u100.html
Performance: Good: 72 - total score in seconds: 6790

http://www.pcworld.com/reviews/product/34873/tests/ideapad_s10.html
Performance: Very Good: 81 - total score in seconds:
6800 (not including Roxio score as other tests did not report this
number)

http://www.pcworld.com/reviews/product/34874/tests/aspire_one.html
Performance: Good: 72 - total score in seconds: 7160

So why did the Lenovo Ideapad S10 score higher than the MSI Wind U100?

Additionally, I have an old Sharp Actius MP30. Anyone know if there are any
comparable test results for this computer to the others mentioned above?
http://www.pcworld.com/reviews/product/23928/tests/actius_mp30_notebook.html

I am interested in knowing whether these newer ultra-portable laptops
are actually any better than my existing Sharp MP30?
Reply
Click to view JamesM's profile PCW Test Center 10 posts since
Aug 18, 2006
1. Dec 2, 2008 1:54 PM in response to: spockcat
Re: Worldbench numbers??
WorldBench 5 and 6 both use the same method of calculating overall scores but use different sets of tests, weightings, and baseline scores so the results can not be compared to oneanother. See the "Test Results Calculation" section of the documentation which explains how the overall WorldBench score is created (excerpt from WorldBench 5 help file below).

"

Test Results Calculation

What the Results Mean
WorldBench takes the time information from 13 different application tests and calculates a composite WorldBench score used to compare PC system performance. WorldBench uses a normalized, weighted harmonic mean to calculate its final WorldBench score. Every system that completes a WorldBench application successfully will receive a WorldBench score. Our baseline system is assigned a WorldBench score of 100, and all other systems are compared to this single unit. In any comparison, the system with the larger WorldBench score also has faster system performance.

See also index topic "Results View Dialog Box."
What is a harmonic mean?

A harmonic mean is a way of comparing time data as a frequency of completion rather than using total time. Normalized harmonic means are useful when you want to compare applications that have different workloads and completion times associated with them. Normalizing brings the applications into scale with each one another so we can produce a mean according to our defined weightings.
Why not use a geometric mean?

We considered using a geometric mean for our composite method. However, PC World wants to allow systems to fail one or more applications on WorldBench because several applications are very system-intensive and low-end systems may be incapable of finishing them. The logical conclusion if you get a null result for any application using a geometric mean is a zero overall score, which is unacceptable as a method of comparison for PC World.

Generating a WorldBench Score?
When you perform a Full Run of WorldBench it will by default run three passes of every application. At the end of a successful run, WorldBench calculates if any of the passes were failures or outliers (results that likely contained some system hang-up). If any runs are deemed unacceptable, WorldBench will run additional passes of all the inconsistent applications. At the end of all the runs, a WorldBench score is calculated based on the three most consistent results from each set of runs. This score will have "WB Score" and brackets containing additional information in the System ID field of the Results View.

"

Copyright © PC World Magazine

Visit other IDG sites: