Wrapping Up the Architecture and Efficiency Discussion

Engineering is all about tradeoffs and balance. The choice to increase capability in one area may decrease capability in another. The addition of a feature may not be worth the cost of including it. In the worst case, as Intel found with NetBurst, an architecture may inherently flawed and a starting over down an entirely different path might be the best solution.

We are at a point where there are quite a number of similarities between NVIDIA and AMD hardware. They both require maintaining a huge number of threads in flight to hide memory and instruction latency. They both manage threads in large blocks of threads that share context. Caching, coalescing memory reads and writes, and handling resource allocation need to be carefully managed in order to keep the execution units fed. Both GT200 and RV770 execute branches via dynamic predication of direction a thread does not branch (meaning if a thread in a warp or wavefront branches differently from others, all threads in that group must execute both code paths). Both share instruction and constant caches across hardware that is SIMD in nature servicing multiple threads in one context in order to effect hardware that fits the SPMD (single program multiple data) programming model.

But the hearts of GT200 and RV770, the SPA (Steaming Processor Array) and the DPP (Data Parallel Processing) Array, respectively, are quite different. The explicitly scalar one operation per thread at a time approach that NVIDIA has taken is quite different from the 5 wide VLIW approach AMD has packed into their architecture. Both of them are SIMD in nature, but NVIDIA is more like S(operation)MD and AMD is S(VLIW)MD.


AMD's RV770, all built up and pretty

Filling the execution units of each to capacity is a challenge but looks to be more consistent on NVIDIA hardware, while in the cases where AMD hardware is used effectively (like Bioshock) we see that RV770 surpasses GTX 280 in not only performance but power efficiency as well. Area efficiency is completely owned by AMD, which means that their cost for performance delivered is lower than NVIDIA's (in terms of manufacturing -- R&D is a whole other story) since smaller ICs mean cheaper to produce parts.


NVIDIA's GT200, in all its daunting glory

While shader/kernel length isn't as important on GT200 (except that the ratio of FP and especially multiply-add operations to other code needs to be high to extract high levels of performance), longer programs are easier for AMD's compiler to extract ILP from. Both RV770 and GT200 must balance thread issue with resource usage, but RV770 can leverage higher performance in situations where ILP can be extracted from shader/kernel code which could also help in situations where the GT200 would not be able to hide latency well.

We believe based on information found on the CUDA forums and from some of our readers that G80's SPs have about a 22 stage pipeline and that GT200 is also likely deeply piped, and while AMD has told us that their pipeline is significantly shorter than this they wouldn't tell us how long it actually is. Regardless, a shorter pipeline and the ability to execute one wavefront over multiple scheduling cycles means massive amounts of TLP isn't needed just to cover instruction latency. Yes massive amounts of TLP are needed to cover memory latency, but shader programs with lots of internal compute can also help to do this on RV770.

All of this adds up to the fact that, despite the advent of DX10 and the fact that both of these architectures are very good at executing large numbers of independent threads very quickly, getting the most out of GT200 and RV770 requires vastly different approaches in some cases. Long shaders can benefit RV770 due to increased ILP that can be extracted, while the increased resource use of long shaders may mean less threads can be issued on GT200 causing lowered performance. Of course going the other direction would have the opposite effect. Caches and resource availability/management are different, meaning that tradeoffs and choices must be made in when and how data is fetched and used. Fixed function resources are different and optimization of the usage of things like texture filters and the impact of the different setup engines can have a large (and differing with architecture) impact on performance.

We still haven't gotten to the point where we can write simple shader code that just does what we want it to do and expect it to perform perfectly everywhere. Right now it seems like typical usage models favor GT200, while relative performance can vary wildly on RV770 depending on how well the code fits the hardware. G80 (and thus NVIDIA's architecture) did have a lead in the industry for months before R600 hit the scene, and it wasn't until RV670 that AMD had a real competitor in the market place. This could be part of the reason we are seeing fewer titles benefiting from the massive amount of compute available on AMD hardware. But with this launch, AMD has solidified their place in the market (as we will see the 4800 series offers a lot of value), and it will be very interesting to see what happens going forward.

AMD's RV770 vs. NVIDIA's GT200: Which one is More Efficient? One, er, Hub to Rule them All?
Comments Locked

215 Comments

View All Comments

  • paydirt - Wednesday, June 25, 2008 - link

    This is a review site. This isn't a site to market/promote products.
  • formulav8 - Thursday, June 26, 2008 - link

    They do recommend hardware for different price points and such. So they do market in a way. Have you seen anands picks links? That is promoting products and does it through his referral links as well to get paid to do so. :)

    Anyways, mentioning something as a better buy up to a certain price point would be helpful to someone who is not really in the know.



    Jason
  • shadowteam - Wednesday, June 25, 2008 - link

    You've got excellent written skills buddy, and I can't help thinking you're actually better at reviews than your m8 (no offence Anand), but what I truly meant from my post above is what you summed up rather well in your conclusive lines, quote: "You can either look at it as AMD giving you a bargain or NVIDIA charging too much, either way it's healthy competition in the graphics industry once again (after far too long of a hiatus)"

    Either way? Why should anyone look the other way? NV is clearly shitting all over the place, and you can tell that from the email they send you (or Anand) a couple days back. So they ripped us off for 6 months, and now suddenly decide the 9800GTX is worth $200?

    Healthy competition? Could you please elaborate on this further?
    $199 4850 vs $399 GTX260.... yup! that's healthy

    GTX+ vs 4850?
    Does that mean the GTX260 is now completely irrelevant? In fact, the 2xx series is utterly pointless no matter how you look at it.

    To bash on AMD, the 4870 is obviously priced high. For $100 extra, all you get is an OC'ed 4850 w/ DDR5 support. I don't think anyone here cares about DDR5, all that matters is performance, and the extra bucks plainly not worth it. From a consumers' perspective, the 4850 is the best buy, the 4870 isn't.
  • mlambert890 - Sunday, July 13, 2008 - link

    "200 series is utterly pointless"

    Yep... pointless unless you want the fastest card (280), then it has a point.

    Pointless to YOU possibly because you're focusing on perf per dollar. Good for you. Nice of you to presume to force that view on the world.

    Absolute performance? GTX 280 seems near the top of every benchmark there bud. Both in single card and in SLI where, last I checked, it gives up maybe TWO instances to the 4870CF - Bioshock and CoD and in both cases framerates are north of 100 at 2560. The 4870, on the other hand, falls WELL short of playable at that res in CF in most other benches.

    High res + high perf = 200 series. Sorry if thats offensive to the egos of those who cant afford the cards.

    Theres a lot in life we can and cant afford. Should have ZERO impact on ABSOLUTE PERFORMANCE discussions.
  • FITCamaro - Wednesday, June 25, 2008 - link

    AMD/ATI has to make some money somewhere. And regardless, at $300, the 4870 is a hell of a deal compared to the competition. Yes the 4850 is probably the best value. But the 4870 is still right behind it if you want a decent amount of extra performance at a great price.

    Nvidia may have the fastest thing out there. But only the richest, most brain dead idiots who have not a care in the world about how they spend their (or their parents) money will buy it with cards like the 4850 and 4870 available.

    And its pretty sad when your new $650 high end card is routinely beat by two of your last generation cards (8800GT) that you can get for $150 each or less. It wouldn't be as big a deal if the new card was $300-350 but at $650, it should be stomping on it.

    I think Nvidia is in for a reality check for what people want. If their new chips are only going to cater to the top 1% of the market, they're going to find themselves quickly in trouble. Especially with the all the issues their chipsets have for 6 months after release. And their shoddy drivers. I mean this past Friday I decided to try and set up some profiles so that when I started up Age of Conan, it would apply an overclock to my GPU and unapply it after I exited, it ended up locking up my PC continuously. I had to restore my OS from a backup disc because not even completely uninstalling and reinstalling my nvidia chipset and video drivers fixed it. And in my anger, I didn't back up my "My Documents" folder so I lost 5 years worth of stuff, largely pictures.
  • mlambert890 - Sunday, July 13, 2008 - link

    "Nvidia may have the fastest thing out there. But only the richest, most brain dead idiots who have not a care in the world about how they spend their (or their parents) money will buy it with cards like the 4850 and 4870 available."

    You just summed it up in that first sentence there bud. NVidia has the fastest thing out there. The rest is just opinion, bitterness and noise.

    I notice that the tone of the "enthusiast" community seems to be laser focused on cost now. This is like car discussions. People want to pretend to be "Xtreme" but what they really want to see is validation of whatever it is THEY can afford.

    Have fun with the 4870 by all means, its a great card. But the GTX280 IS faster. Did NVidia price it too high? Dont know and dont care.

    These are PERFORMANCE forums to all of the people that dont get that. Maybe even the editors need to be reminded.

    If I want to see an obsession with "bang for the buck" Ill go to Consumer Reports.

    I mean seriously. How much of a loser are you when you're taking a shot like "your PARENTS money"? LOL...

    Personally, I treat the PC hobby as an expensive distraction. Ive been a technology pro for 15 years now and this is my vice. As an adult earning my own money, I can decide how I spend it and the difference between $500 and a grand isnt a big deal.

    The rehtoric on forums is really funny. People throw the "kid/parents" insult around alot, but I think its more likely that the people who take prices beyond what they can afford as some kind of personal insult are more likely the kids here.
  • formulav8 - Thursday, June 26, 2008 - link

    "Nvidia may have the fastest thing out there. But only the richest, most brain dead idiots who have not a care in the world about how they spend their (or their parents) money will buy it with cards like the 4850 and 4870 available."


    Yuk Yuk Yuk :)



    Jason
  • drpepper128 - Wednesday, June 25, 2008 - link

    To be honest, while I was reading the article I felt as if the article seemed a little ATI biased, but I guess that goes to show you that two different people can get drastically different opinions from the same article.

    The real reason I’m posting this is I want to thank you guys for writing some of the best articles that Anandtech has ever written. I read every page and enjoyed the whole thing. Keep up the great work guys and I look forward to reading more (especially about Nehalem and anything relating to AMD’s future architecture).

    Also, is GDDR5 coming to the 4850 ever? If so, maybe it would be a drastically better buy.

    Thank you,
    drpepper128
  • Clauzii - Wednesday, June 25, 2008 - link

    Damn, You R pissed!! :O

    OK, get some sleep and wake up smiling tomorrow, knowing that It's ATI needing to raise prices - - - and go get that 4870 :))
  • Clauzii - Wednesday, June 25, 2008 - link

    OH, " ... that It's NOT ATI needing to ... "

    BTW: I actually read the review as pretty neutral, making a hint here and there that the further potential of the HD4870 is quite big :)

Log in

Don't have an account? Sign up now