Testing Methodology, Hardware Configurations

To start, we want to thank the many manufacturers who have donated kit for our test beds in order to make this review, along with many others, possible.

Thank you to OCZ for providing us with 1250W Gold Power Supplies.
Thank you to G.Skill for providing us with memory kits.
Thank you to Corsair for providing us with an AX1200i PSU and 16GB 2400C10 memory.
Thank you to ASUS for providing us with the AMD GPUs and some IO Testing kit.
Thank you to ECS for providing us with the NVIDIA GPUs.
Thank you to Corsair for providing us with the Corsair H80i CLC.
Thank you to Rosewill for providing us with the 500W Platinum Power Supply for mITX testing, BlackHawk Ultra, and 1600W Hercules PSU for extreme dual CPU + quad GPU testing, and RK-9100 keyboards.
Thank you to Gigabyte for providing us with the X5690 CPUs.

Also many thanks go to the manufacturers who over the years have provided review samples which contribute to this review.

Testing Methodology

In order to keep the testing fair, we set strict rules in place for each of these setups.  For every new chipset, the SSD was formatted and a fresh installation of the OS was applied.  The chipset drivers for the motherboard were installed, along with NVIDIA drivers then AMD drivers.  The games were preinstalled on a second partition, but relinked to ensure they worked properly. The games were then tested as follows:

Metro 2033: Benchmark Mode, two runs of four scenes of Frontline at 1440p, max settings.  First run of four is discarded, average of second run is taken (minus outliers).
Dirt3: Benchmark Mode, four runs of the first scene with 8 cars at 1440p, max settings.  Average is taken.
Civilization V: One five minute run of the benchmark mode accessible at the command line, at 1440p and max settings.  Results produced are total frames in sets of 60 seconds, average taken.
Sleeping Dogs: Using the Adrenaline benchmark software, four scenes at 1440p in Ultra settings.  Average is taken.

If the platform was being used for the next CPU (e.g. Maximus V Formula, moving from FX-8150 to FX-8350), no need to reinstall.  If the platform is changed for the next test, a full reinstall and setup takes place.

How to Read This Review

Due to the large number of different variables in our review, it is hard to accurately label each data point with all the information about that setup.  It also stands to reason that just putting the CPU model is also a bad idea when the same CPU could be in two different motherboards with different GPU lane allocations.  There is also the memory aspect to consider, as well as if a motherboard uses MCT at stock.  Here is a set of labels correlating to configurations you will see in this review:

CPU[+] [CP] (PCIe version – lane allocation to GPUs [PLX])

First is the name of the CPU, then an optional + identifier for MCT enabled motherboards.  CP indicates we are dealing with a Bulldozer derived CPU and using the Core Parking updates.  Inside the circular brackets is the PCIe version of the lanes we are dealing with, along with the lane allocation to each GPU.  The final flag is if a PLX chip is involved in lane allocation.

A10-5800K (2 – x16/x16): A10-5800K with two GPUs in PCIe 2.0 mode
A10-5800K (CP) (2 – x16/x16): A10-5800K using Core Parking updates with two GPUs in PCIe 2.0 mode
FX-8350K (2 – x16/x16/x8): FX-8350 with three GPUs in PCIe 2.0 mode
i7-3770K (3+2 – x8/x8 + x4): i7-3770K powering three GPUs in PCIe 3.0 but the third GPU is using the PCIe 2.0 x4 from the chipset
i7-3770K+ (3 – x16): i7-3770K (with MCT) powering one GPU in PCIe 3.0 mode
i7-3770K+ (3 – x8/x8/x8/x8 PLX): i7-3770K (with MCT) powering four GPUs in PCIe 3.0 via a PLX chip

Common Configuration Points

All the system setups below have the following consistent configurations points:

- A fresh install of Windows 7 Ultimate 64-bit
- Either an Intel Stock CPU Cooler, a Corsair H80i CLC or Thermalright TRUE Copper
- OCZ 1250W Gold ZX Series PSUs (Rosewill 1600W Hercules for The Beast)
- Up to 4x ASUS AMD HD 7970 GPUs, using Catalyst 13.1
- Up to 2x ECS NVIDIA GTX 580 GPUs, using GeForce WHQL 310.90
- SSD Boot Drives, either OCZ Vertex 3 128 GB or Kingston HyperX 120 GB
- LG GH22NS50 Optical Drives
- Open Test Beds, either a DimasTech V2.5 EasyHard or a CoolerMaster Test Lab

Configurations

An asterisk (*) indicates the new data for this update.

AMD

A6-3650 + Gigabyte A75-UD4H + 16GB DDR3-1866 8-10-10
A8-3850 + ASRock A75 Extreme6 + 16GB DDR3 1866 8-10-10
A8-5600K + Gigabyte F2A85-UP4 + 16GB DDR3-2133 9-10-10
A10-5800K + Gigabyte F2A85-UP4 + 16GB DDR3-2133 9-10-10
X2-555 BE + ASUS Crosshair V Formula + 16GB DDR3 1600 8-8-8
X4-960T + ASUS Crosshair V Formula + 16GB DDR3-1600 8-8-8
X6-1100T + ASUS Crosshair V Formula + 16GB DDR3-1600 8-8-8
FX-8150 + ASUS Crosshair V Formula + 16GB DDR3-2133 10-12-11
FX-8350 + ASUS Crosshair V Formula + 16GB DDR3-2133 9-11-10
FX-8150 + ASUS Crosshair V Formula + 16GB DDR3-2133 10-12-11 + CP
FX-8350 + ASUS Crosshair V Formula + 16GB DDR3-2133 9-11-10 + CP

Intel

E6400 + MSI i975X Platinum + 4GB DDR2-666 5-6-6
*E6400 + ASUS P965 Commando + 4GB DDR2-666 4-5-5
*E6550 + ASUS P965 Commando + 4GB DDR2-666 5-6-6
E6700 + ASUS P965 Commando + 4GB DDR2-666 4-5-5
*Q9400 + ASUS P965 Commando + 4GB DDR2-666 5-6-6
Xeon X5690 + EVGA SR-2 + 6GB DDR3 1333 6-7-7
2x Xeon X5690 + EVGA SR-2   + 9GB DDR3 1333 6-7-7
Celeron G465 + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i5-2500K + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i7-2600K + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i3-3225 + ASUS Maximus V Formula + 16GB DDR3-2400 10-12-12
i7-3770K + Gigabyte Z77X-UP7 + 16GB DDR3-2133 9-11-11
i7-3770K + ASUS Maximus V Formula + 16GB DDR3-2400 9-11-11
i7-3930K + ASUS Rampage IV Extreme + 16GB DDR3-2133 10-12-12
i7-3960X + ASRock X79 Professional + 16GB DDR3-2133 10-12-12
*i7-4770K + Gigabyte Z87X-UD3H + 16GB DDR3-2400 10-12-12
*i7-4770K + ASUS Z87-Pro + 16GB DDR3-2400 10-12-12
*i7-4770K + MSI Z87A-GD65 Gaming + 16GB DDR3-2400 10-12-12

CPUs, GPUs, Motherboards, and Memory CPU Benchmarks
Comments Locked

116 Comments

View All Comments

  • IanCutress - Tuesday, June 4, 2013 - link

    Hi Ternie,

    To answer your questions:

    (1) Unfortunately for a lot of users, even DIY not just system integrators, they leave the motherboard untouched (even at default memory, not XMP). So choosing that motherboard with MCT might make a difference in performance. Motherboards without MCT are also different between themselves, depending on how quickly they respond to CPU loading and ramp up the speed, and then if they push it back down to idle immediately in a low period or keep the high turbo for a few seconds in case the CPU loading kicks back in.

    2) This is a typo - I was adding too many + CPU results at the same time and got carried away.

    3) While people have requested more 'modern' games, there are a couple of issues. If I release something that has just come out, the older drivers I have to use for consistency will either perform poorly or not scale (case in point, Sleeping Dogs on Catalyst 12.3). If I am then locked into those drivers for a year, users will complain that this review uses old drivers that don't have the latest performance increases (such as 8% a month for new titles not optimized) and that my FPS numbers are unbalanced. That being said, I am looking at what to do for 2014 and games - it has been suggested that I put in Bioshock Infinite and Tomb Raider, perhaps cut one or two. If there are any suggestions, please email me with thoughts. I still have to keep the benchmarks regular and have to run without attention (timedemos with AI are great), otherwise other reviews will end up being neglected. Doing this sort of testing could easily be a full time job, which in my case should be on motherboards and this was something extra I thought would be a good exercise.
  • Michaelangel007 - Tuesday, June 4, 2013 - link

    It is sad to poor journalism in the form of excuses in an otherwise excellent article. :-/

    1. Any review sites that make excuses for why they ignore FCAT just highlights that they don't _really_ understand the importance of _accurate_ frame stats.
    2. Us hardcore games can _easily_ tell the difference betwen 60 Hz and 30 Hz. I bought a Titan to play games at 1080p @ 100+ Hz on the Asus VG248QE using nVidia's LightBoost to eliminate ghosting. You do your readers a dis-service by again not understand the issue.
    3. Focusing on 1440 is largely useless as it means people can't directly compare how their Real-World (tm) system compares to the benchmarks.
    4. If your benchmarks are not _exactly_ reproducible across multiple systems you are doing it wrong. Name & Shame games that don't allow gamers to run benchmarks. Use "standard" cut-scenes for _consistency_.

    It is sad to see the quality of a "tech" article gloss and trivial important details.
  • AssBall - Tuesday, June 4, 2013 - link

    Judging by your excellent command of English, I don't think you could identify a decent technical article if it slapped you upside the head and banged your sister.
  • Razorbak86 - Tuesday, June 4, 2013 - link

    LOL. I have to agree. :)
  • Michaelangel007 - Wednesday, June 5, 2013 - link

    There is a reason Tom's Hardware, Hard OCP, guru3d, etc. uses FCAT.

    I feel sad that you and AnandTech tech writers are to stupid to understand the importance of high frame rates (100 Hz vs 60 Hz vs 30 Hz), frame time variance, 99 percentile, proper CPU-GPU load balancing, and micro stuttering. One of these days when you learn how to spell 'ad hominem' you might actually have something _constructive_ to add to the discussion. Shooting the messenger instead of focusing on the message shows you are still a immature little shit that doesn't know anything about GPUs.

    Ignoring the issue (no matter how badly communicated) doesn't make it go away.

    What are _you_ doing to help raise awareness about sloppy journalism?
  • DaveninCali - Tuesday, June 4, 2013 - link

    Why doesn't this long article include AMD's latest APU, the Richland 6800K? Heck you can even buy it now on Newegg.
  • ninjaquick - Tuesday, June 4, 2013 - link

    The data collected in this article is likely a week or two old. Richland was not available at that time. It takes an extremely long time to do this kind of testing.
  • DaveninCali - Tuesday, June 4, 2013 - link

    Richland was launched today. Haswell was launched two days ago. Neither CPU was available two weeks ago. It all depends on review units being released to review websites. Either Richland was left out because it wasn't different enough from Trinity to matter or AMD did not hand out review units.
  • majorleague - Wednesday, June 5, 2013 - link

    Here is a youtube link showing 3dmark11 and windows index rating for the 4770k 3.5ghz Haswell. Not overclocked.

    Youtube link:
    http://www.youtube.com/watch?v=k7Yo2A__1Xw
  • Chicken76 - Tuesday, June 4, 2013 - link

    Ian, in the table on page 2 there's a mistake: the Phenom II X4 960T has a stock speed of 3 GHz (you listed 3.2 GHz) and it does turbo up to 3.4 GHz.

Log in

Don't have an account? Sign up now