Filed under: OS, TUAW Labs, Snow Leopard
Benchmarking results: Is Snow Leopard really any faster than Leopard?
Be sure to check all of our ongoing Snow Leopard coverage right here.One of the biggest features of Snow Leopard isn't something apparent to the naked eye: software tweaks and refinements intended to make OS X a leaner, meaner OS for your fighting Apple machine. But is Snow Leopard really any faster? Now that I've successfully upgraded two Macs to Snow Leopard I've got some benchmarking results to share.
My Early 2008 MacBook Pro shipped with OS X Leopard 10.5.2 installed. I ran Geekbench on the stock OS X installation after upgrading the RAM to 4 GB to get a baseline for comparison of future performance. 18 months later I ran the same test immediately after updating to 10.6. Both tests were performed with Geekbench testing in 32-bit mode immediately after a restart, with no other programs open except the Finder, nothing loaded in Dashboard, and no Time Machine backup running.
Machine specs:
Intel Core 2 Duo @ 2.60 GHz w/ 4GB RAM
Average Overall Geekbench score for this model of MacBook Pro: 3304
Read on for the scores.
Intel Core 2 Duo @ 2.60 GHz w/ 4GB RAM
Average Overall Geekbench score for this model of MacBook Pro: 3304
Read on for the scores.
10.5.2 results:
Overall Score: 3364
Integer: 2965
Floating Point: 4785
Memory: 2412
Stream: 1692
10.6 results:
Overall Score: 3511
Integer: 3082
Floating Point: 5055
Memory: 2467
Stream: 1701
The benchmarking gains are small, particularly in memory and stream performance, where the gains are negligible and most likely just a statistical deviation. Overall performance has gone up by just over 4%, with the biggest performance gains seen in floating point operations, which increased by 5%.
My wife's late-2006 MacBook saw similar gains in performance, but with her machine I have three sets of values to compare: performance with a base installation of 10.5.2, with 10.5.8, and with a brand-new 10.6 install.
Machine specs:
Intel Core 2 @ 2.16 GHz w/ 2GB RAM
Average Overall Geekbench score for this model of MacBook: 2741
10.5.2 results:
Overall Score: 2773
Integer: 2451
Floating Point: 3894
Memory: 1975
Stream: 1577
10.5.8 results:
Overall Score: 2849
Integer: 2365
Floating Point: 4249
Memory: 1907
Stream: 1528
10.6 results:
Overall Score: 2977
Integer: 2444
Floating Point: 4484
Memory: 1975
Stream: 1577
Once again there's no gain in memory or stream performance, but measurable gains in overall scores and floating point performance. Between 10.5.2 and 10.6, there's a jump of 7.4% in overall score and a significant increase of 15% in floating point performance.
Joachim Bean's Geekbench scores on his Mac Mini showed a similar 3-5% gain in performance just by upgrading to Snow Leopard.
While the performance gains aren't huge, they do seem to reflect the optimizations present in Snow Leopard. And this is really just the tip of the iceberg when it comes to Snow Leopard's potential. Once developers start taking advantage of new technologies like Grand Central and OpenCL, applications in OS X will be screamingly fast.
Get a WordPress.com Blog
![TUAW [Cafepress]](http://www.blogsmithmedia.com/www.tuaw.com/media/tuaw-cafepress-promo.png)


Reader Comments (Page 1 of 4)
Greenie said 9:06AM on 9-02-2009
The amazing thing is Apple makes older hardware run faster with even less code. That's really quite a feat.
Reply
Janichsan said 1:30PM on 9-02-2009
Not really. That's just called "optimisation", something that basically all software developers tend to neglect, basically by relying on to the ever faster hardware to balance the sloppy programming. Glad to see that Apple tries to reverse that trend.
Ryan Trevisol said 10:16AM on 9-02-2009
It is pretty amazing, and certain things are definitely faster, no placebo effect. However, I've said this before, and I'll say it again; they're optimizing this for future macs. When the Quad Core iMacs come out, and the 12-core dual i7 Mac Pro's come out, it'll be much more apparent.
Also, when Software Devs start taking advantage of Grand Central, like hopefully Adobe CS5, Aperture 2.5 or 3 (dying to give them my money for this one), and so on, the Snow Leopard advantage will be much more compelling.
Joshua Ochs said 10:37AM on 9-02-2009
I'm replying to this, as it needs to be seen higher up in the comment thread. Not that most people will read past the headline, let alone the article.
This article is a fundamental misunderstanding of benchmarks, and is worse than worthless, it actively misinforms those who also don't understand a benchmark. Issue a clarification of this ASAP.
No OS is going to make your hardware magically faster (seriously, how do you think computers work - pixie dust?). However, the software included in the OS - the API's, frameworks, and programs like the Finder may be faster, or they may employ better algorithms and techniques, such as when 10.1 enabled prebinding for all applications, or Boot Caches added several versions ago, or the new Snow Leopard shutdown procedure.
Microdot said 10:50AM on 9-02-2009
as joshua said... im kind of shocked that you guys dont understand that a hardware bench test has little to nothing to do with the os running it.
Chris said 11:26AM on 9-02-2009
As Joshua says, this benchmark is 99.9% about the underlying hardware, and has almost nothing at all to do with the OS.
A more useful benchmark would reflect real-world actions and most likely would show the significant speed improvements we've been hoping/expecting.
How about some Automator-based task? Perform some batch image resize/transform operations (in Preview to have a chance of exercising GC/OpenCL), then export to iMovie and encode to a slideshow maybe? Whatever the tasks, they should be Apple apps all the way, since nothing else is likely to take advantage of GC/OpenCL yet. Run the same action on Leopard v.s. Snow Leopard and the results are much more likely to be interesting.
A User said 11:34AM on 9-02-2009
Microsoft is great too. It gives you more code (larger OS) for the same price and help you to make faster decision on buying newer and faster system to support their slower OS.
bob said 11:43AM on 9-02-2009
i have a 1 1/2 year old mac pro and its faster than when brand new, now everything, not just my pro apps can use all of my 8 cores and 10gb, looking forward to seeing the devs use the new tech too.
elldove said 3:20PM on 9-02-2009
Chris said 11:26AM on 9-02-2009
A more useful benchmark would reflect real-world actions and most likely would show the significant speed improvements we've been hoping/expecting.
Yeah, I'm finding the most noticeable increase in speed and responsiveness is not with a speed-bump to specific apps, as the benchmarking test. But where SL shines is when you've got many apps and windows running at once, competing for resources. Even though most 3rd part apps are not yet written for SL, having the finder, dock, window manager, application switcher, expose all able to take advantage of multiple cores means that even when one application gets slogged down, you can still expose/command-tab out of it and still find a snappy finder, mail, safari which seem unaffected (or at least less so) by Photoshop churning through a filter...
this was not true in Leopard... I'm not sure I've seen the ol' beach ball since i upgraded
dagaz said 5:43PM on 9-02-2009
@Joshua, Microdot, Chris
How do you guys then explain the increases in GeekBench scores?
CyBeR said 8:36PM on 9-02-2009
dagaz: The OS is still the layer inbetween you (geekbench) and the hardware. There are still small details that can be optimized to squeeze that last bit out of that. For instance, if Leopard had to call two functions to copy X bytes memory around, and they managed to do it in one in Snow Leopard, that could be a slight increase in efficiency (no second function call, saves a few instructions). If such a thing happens often enough (say, thousands of times per second) you'll notice the slight difference.
Of course, the 'stream' bench is really purely a hardware test. There's not much OS between that anymore and what's there likely hasn't changed in a while. It basically entails reading, as fast as you can, from memory and discarding the result. So what you're measuring there is simply the bandwidth between memory and the CPU. This explains their similarity (the difference is, indeed, statistical deviation most likely caused by less memory activity on the higher side.)
cabdriverjim said 10:01AM on 9-03-2009
Well, it would be rather paradoxical if they managed to make software run faster by adding more code. In general, less code = less time to execute.
hebejebelus said 9:07AM on 9-02-2009
Well, yeah. It would be interesting to see results for the 64-bit version, but otherwise, it's just the same program, running on the same hardware, running on pretty much the same infrastructure.
Reply
Greg said 9:08AM on 9-02-2009
I doubt the benchmark was designed to work with GCD and OpenGL...
Reply
Josh said 9:10AM on 9-02-2009
Thanks for the stats, thats very interesting to see. I wonder how the performance difference is on the mid-2009 MBPs. I just upgraded mine to SL, but also upgraded my HD as well, so its hard to tell what made more of a difference.
Reply
iLikeMyiPhone said 9:16AM on 9-02-2009
Unfortunately, I see no speed improvements, it just Leopard. Apple should have sent it out as 10.5.7 or something, not worth a 10.6 status (I know 64 bit and stuff but well!)...Anything more than $29 is not worth it, $169 box set users - I pity you for ponying so much money!
Reply
Mike said 10:51AM on 9-02-2009
yes cause 30 bucks is so expensive... it amazes me how much of the general mac popluation are cheap skates first of you complain about 2bucks for 8021.n enabler for the iMac then say 9.99 is to much for a firmware update and now 30 bucks is to expensive for a OS. give me a break.
mistersmith85 said 11:12AM on 9-02-2009
@ Mike
I am one of those cheapskates you speak of, but not because I'm a complainer; but because I like to SEE the value. I didn't want to pay $2 for the 802.11n enabler because it wasn't worth it with my current setup and in all reality should have been enabled at the factory. And eventually, I got it for free when I bought a used Time Machine.
I upgraded my iPod Touch to 3.0 on a friends computer to save some cash; and I would have a right to be upset that a $10 charge is being applied because I don't have a monthly contract and a phone built-in. In all reality, I just didn't see the value in the other paid upgrade (2.1 I think).
The way Apple talked about Snow Leopard made me think that it wasn't worth $29. I wanted it because I love my new MBPro and I knew that eventual updates would make it faster and better; but at the keynote they made it sound like nothing more than update (with the exclusion of a rewritten finder). But luckily, being the cheapskate that I am, I was able to purchase the $10 up-to-date version.
See? It all works out in the end for a Mac user.
matthew said 11:25AM on 9-02-2009
There are OpenGL regressions in 10.6.0 which mean 3D performance will be hampered. This should apparently be fixed in the next point update.
see: http://www.phoronix.com/forums/showpost.php?p=89411&postcount=3
Reply
Janichsan said 2:48PM on 9-02-2009
I see this Phoronix stuff turn up on almost every Mac webpage, but that does not make it any more meaningful: Phoronix *only* tested the OpenGL performance on two generations of Mac minis with integrated CPUs.
As long as you don't show me a single benchmark that confirms that OpenGL is slower on *all* types of Macs, no matter what GPU they use, *then* – and not before – you can say there has been a "regression" in OpenGL performance.