Peacekeeper tests under VirtualBox

512MiB RAM, 32MiB vid, 3D hw accel, single core, hardware virtualisation enabled

Results from March 2010

BTW, I've given up on testing on Peacekeeper. There are some serious flaws in their benchmark that they have not corrected. Basic errors in the harness, failure to measure what they think they are measuring (what is being measured is the test harness or due to badly presented problem, how well the browser can hardcode a hack workaround [chrome has a hardcode for the silly .* in the peacekeeper regex for example, other browsers have yet to add the hack]). Last I checked though, on physical machine (not even running Vista, so no D2D) Opera was on top at 6220, followed by Chrome 14 at 5267, follow by Firefox 7 at 4349 and Firefox 5 at 3688. IE8 was 675

Identical VM image used in order to test IE7/IE8/IE9 on this hardware. A move to Vista was forced in order to test IE9. IE9 useragent forcibly changed in registry since it reports IE8 to peacekeeper otherwise. FF3.7 is currently suffering from a regression due to changing regex caching due to new javascript requirements. Also seems to have taken a slight hit in DOM about 5-6%. IE9 while doing the array/string tests did not display the splash image, but that could just be a bug in it. It did not run Canvas, but I understand it is not yet capable of it. This does not count against it in the Peacekeeper benchmark. Detail images are not yet updated. If peacekeeper had a private URL for benchmarking, could just link people to the peacekeeper page.

Some people have raised objections to my testing on a virtual machine, even on a host with hardware virtualisation. Below the virtualised set are my results on a non-virtual machine. IE8/9 are excluded, IE7 was run using IE7 standalone. The gap between Minefield and Chromium does shrinks from 37% to 20% and Opera and Firefox 3.5 are neck and neck. Of course this is on a completely different set of system specs.

Overall peacekeeper test result on virtual machine Overall peacekeeper test result on physical machine: Chrome 4.0.207.0/3220, Safari 4.0.2/3181, Safari 4.0.3/3177, Chrome 4.0.221.6/3151, Chrome 3.0.192.0/3068, Minefield 3.7a1pre/2586, Minefield 3.6a2pre/2273, Minefield 3.6a1pre/2250, Opera 10.00/1836, Firefox 3.5.3/1788, Firefox 3.5.2/1758, Firefox 3.5.1/1736, Firefox 3.0.11/1143, Internet Explorer 6.0/469, Internet Explorer 7.0/461 Detailed Chrome 4.0.219.6 on virtual machine: Rendering/1809, Social networking/2973, Complex graphics/5463, Data/3355, DOM operations/5320, Text parsing/7830 Detailed Safari 4.0.3 on virtual machine: Rendering/1047, Social networking/2303, Complex graphics/2346, Data/4984, DOM operations/4468, Text parsing/4092 Detailed Firefox Minefield 3.7apre1 on virtual machine: Rendering/1788, Social networking/2229, Complex graphics/4090, Data/3500, DOM operations/2189, Text parsing/2504 Detailed Opera 10.00 on virtual machine: Rendering/1803, Social networking/2671, Complex graphics/2806, Data/1226, DOM operations/3411, Text parsing/2223 Detailed Firefox 3.5.3 on virtual machine: Rendering/1550, Social networking/1800, Complex graphics/2649, Data/1828, DOM operations/1921, Text parsing/1657 Detailed Internet Explorer 8.0 on virtual machine: Rendering/1307, Social networking/956, Complex graphics/0, Data/757, DOM operations/631, Text parsing/1101 Detailed Internet Explorer 7.0 on virtual machine: Rendering/1625, Social networking/857, Complex graphics/0, Data/416, DOM operations/267, Text parsing/640 Detailed Internet Explorer 6.0 on virtual machine: Rendering/1178, Social networking/970, Complex graphics/0, Data/416, DOM operations/226, Text parsing/430