MSI Wind U123 and ASUS 1000HE Show Netbook Evolution

Performance Testing

When we first mentioned plans for performance testing of netbooks we encountered stiff resistance from some manufacturers. They expressed concern that performance comparisons defeated the whole idea of a netbook, which is a cheap portable computer based on cheaper processors that provided competent performance for basic computing tasks like web search and writing. While we agree that it would be a mistake to evaluate netbooks on performance alone, the facts are that netbook performance is increasing rapidly, as is the definition of what represents a "basic" computing task.

If the first netbooks represent all that is needed in a netbook there would be no reason at all for any future models. In fact people are doing more and more with netbooks - and the more that is demanded of these little computers the more that is demanded in raw computing power. The caveat, of course, is that it is unfair to compare the performance of a $300 to $400 netbook to a $2000 state-of-the-art notebook. They are aimed at different users and tasks. However, with the growth of computing power in recent years it is truly remarkable how very much the tiny netbook is actually able to do today.

Determining the best method for testing netbook performance proved quite a challenge. Of the readily available test suites PCMark Vantage seemed the ideal tool for testing overall computing capabilities. The problem is that Vantage only runs on Windows Vista and none of the current netbooks available for testing even offer Vista as an OS option. In addition Vantage requires a 1280x1024 minimum screen configuration which is far beyond resolution capabilities of current netbooks, so we would need to attach an external display.

Serious consideration was given to testing netbooks with Linux or a Linux variant OS like Ubuntu. In staff discussions at AnandTech we looked at benchmark issues with testing Linux notebooks, and we also considered the fact that all of the netbooks in house for testing had arrived with the Windows XP Home OS installed.  We do plan to compare "Linux" and Microsoft OS options on netbooks in a future article.

With Windows XP Home already installed on all five netbooks that became our current OS choice for performance comparisons. Even that choice presents testing problems. PCMark05 runs fine on Windows XP, but the test suite still requires a minimum screen resolution of 1024x768 and several test modules fail at any lower resolution. The best current netbooks can do is 1024x600. After considering various options PCMark05 testing was standardized on an external monitor fed by the netbook being tested at a 1024x768 resolution. On some netbooks the screen output at 1024x768 is hardly ideal, but using a standard resolution removed a variable from the performance testing.

With the continuing growth in computing power in netbooks we fully expect to add additional tests to our netbook test suite. It is common knowledge that current netbooks can handle Flash and streaming videos present on the web without much difficulty. We confirmed this in our own internal testing. We also concur with other reports that current netbooks can handle up to 720p video playback with relative ease. However 1080p and BD playback is definitely beyond current capabilities.

In the future there is no doubt netbooks will be able to smoothly handle higher resolution video playback, Blu-ray, and perhaps even mid-level gaming. As those capabilities appear we will add relevant tests to the netbook test suite.