Testing Methodology, Hardware Configurations

To start, we want to thank the many manufacturers who have donated kit for our test beds in order to make this review, along with many others, possible.

Thank you to OCZ for providing us with 1250W Gold Power Supplies.
Thank you to G.Skill for providing us with memory kits.
Thank you to Corsair for providing us with an AX1200i PSU and 16GB 2400C10 memory.
Thank you to ASUS for providing us with the AMD GPUs and some IO Testing kit.
Thank you to ECS for providing us with the NVIDIA GPUs.
Thank you to Corsair for providing us with the Corsair H80i CLC.
Thank you to Rosewill for providing us with the 500W Platinum Power Supply for mITX testing, BlackHawk Ultra, and 1600W Hercules PSU for extreme dual CPU + quad GPU testing, and RK-9100 keyboards.
Thank you to Gigabyte for providing us with the X5690 CPUs.

Also many thanks go to the manufacturers who over the years have provided review samples which contribute to this review.

Testing Methodology

In order to keep the testing fair, we set strict rules in place for each of these setups.  For every new chipset, the SSD was formatted and a fresh installation of the OS was applied.  The chipset drivers for the motherboard were installed, along with NVIDIA drivers then AMD drivers.  The games were preinstalled on a second partition, but relinked to ensure they worked properly. The games were then tested as follows:

Metro 2033: Benchmark Mode, two runs of four scenes of Frontline at 1440p, max settings.  First run of four is discarded, average of second run is taken (minus outliers).
Dirt3: Benchmark Mode, four runs of the first scene with 8 cars at 1440p, max settings.  Average is taken.
Civilization V: One five minute run of the benchmark mode accessible at the command line, at 1440p and max settings.  Results produced are total frames in sets of 60 seconds, average taken.
Sleeping Dogs: Using the Adrenaline benchmark software, four scenes at 1440p in Ultra settings.  Average is taken.

If the platform was being used for the next CPU (e.g. Maximus V Formula, moving from FX-8150 to FX-8350), no need to reinstall.  If the platform is changed for the next test, a full reinstall and setup takes place.

How to Read This Review

Due to the large number of different variables in our review, it is hard to accurately label each data point with all the information about that setup.  It also stands to reason that just putting the CPU model is also a bad idea when the same CPU could be in two different motherboards with different GPU lane allocations.  There is also the memory aspect to consider, as well as if a motherboard uses MCT at stock.  Here is a set of labels correlating to configurations you will see in this review:

CPU[+] [CP] (PCIe version – lane allocation to GPUs [PLX])

First is the name of the CPU, then an optional + identifier for MCT enabled motherboards.  CP indicates we are dealing with a Bulldozer derived CPU and using the Core Parking updates.  Inside the circular brackets is the PCIe version of the lanes we are dealing with, along with the lane allocation to each GPU.  The final flag is if a PLX chip is involved in lane allocation.

A10-5800K (2 – x16/x16): A10-5800K with two GPUs in PCIe 2.0 mode
A10-5800K (CP) (2 – x16/x16): A10-5800K using Core Parking updates with two GPUs in PCIe 2.0 mode
FX-8350K (2 – x16/x16/x8): FX-8350 with three GPUs in PCIe 2.0 mode
i7-3770K (3+2 – x8/x8 + x4): i7-3770K powering three GPUs in PCIe 3.0 but the third GPU is using the PCIe 2.0 x4 from the chipset
i7-3770K+ (3 – x16): i7-3770K (with MCT) powering one GPU in PCIe 3.0 mode
i7-3770K+ (3 – x8/x8/x8/x8 PLX): i7-3770K (with MCT) powering four GPUs in PCIe 3.0 via a PLX chip

Common Configuration Points

All the system setups below have the following consistent configurations points:

- A fresh install of Windows 7 Ultimate 64-bit
- Either an Intel Stock CPU Cooler, a Corsair H80i CLC or Thermalright TRUE Copper
- OCZ 1250W Gold ZX Series PSUs (Rosewill 1600W Hercules for The Beast)
- Up to 4x ASUS AMD HD 7970 GPUs, using Catalyst 13.1
- Up to 2x ECS NVIDIA GTX 580 GPUs, using GeForce WHQL 310.90
- SSD Boot Drives, either OCZ Vertex 3 128 GB or Kingston HyperX 120 GB
- LG GH22NS50 Optical Drives
- Open Test Beds, either a DimasTech V2.5 EasyHard or a CoolerMaster Test Lab

Configurations

An asterisk (*) indicates the new data for this update.

AMD

A6-3650 + Gigabyte A75-UD4H + 16GB DDR3-1866 8-10-10
A8-3850 + ASRock A75 Extreme6 + 16GB DDR3 1866 8-10-10
A8-5600K + Gigabyte F2A85-UP4 + 16GB DDR3-2133 9-10-10
A10-5800K + Gigabyte F2A85-UP4 + 16GB DDR3-2133 9-10-10
X2-555 BE + ASUS Crosshair V Formula + 16GB DDR3 1600 8-8-8
X4-960T + ASUS Crosshair V Formula + 16GB DDR3-1600 8-8-8
X6-1100T + ASUS Crosshair V Formula + 16GB DDR3-1600 8-8-8
FX-8150 + ASUS Crosshair V Formula + 16GB DDR3-2133 10-12-11
FX-8350 + ASUS Crosshair V Formula + 16GB DDR3-2133 9-11-10
FX-8150 + ASUS Crosshair V Formula + 16GB DDR3-2133 10-12-11 + CP
FX-8350 + ASUS Crosshair V Formula + 16GB DDR3-2133 9-11-10 + CP

Intel

E6400 + MSI i975X Platinum + 4GB DDR2-666 5-6-6
*E6400 + ASUS P965 Commando + 4GB DDR2-666 4-5-5
*E6550 + ASUS P965 Commando + 4GB DDR2-666 5-6-6
E6700 + ASUS P965 Commando + 4GB DDR2-666 4-5-5
*Q9400 + ASUS P965 Commando + 4GB DDR2-666 5-6-6
Xeon X5690 + EVGA SR-2 + 6GB DDR3 1333 6-7-7
2x Xeon X5690 + EVGA SR-2   + 9GB DDR3 1333 6-7-7
Celeron G465 + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i5-2500K + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i7-2600K + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i3-3225 + ASUS Maximus V Formula + 16GB DDR3-2400 10-12-12
i7-3770K + Gigabyte Z77X-UP7 + 16GB DDR3-2133 9-11-11
i7-3770K + ASUS Maximus V Formula + 16GB DDR3-2400 9-11-11
i7-3930K + ASUS Rampage IV Extreme + 16GB DDR3-2133 10-12-12
i7-3960X + ASRock X79 Professional + 16GB DDR3-2133 10-12-12
*i7-4770K + Gigabyte Z87X-UD3H + 16GB DDR3-2400 10-12-12
*i7-4770K + ASUS Z87-Pro + 16GB DDR3-2400 10-12-12
*i7-4770K + MSI Z87A-GD65 Gaming + 16GB DDR3-2400 10-12-12

CPUs, GPUs, Motherboards, and Memory CPU Benchmarks
Comments Locked

116 Comments

View All Comments

  • gonks - Tuesday, June 4, 2013 - link

    Great work Ian! Definitely waiting to see i5-3570K added into the mix, to see how it compares to the i5-2500k (and the 3570k beeing more futureproof thanks to PCIe 3.0).
  • Harby - Tuesday, June 4, 2013 - link

    Excellent review, though it would be awesome to see World of Warcraft and Rift in there. Both are heavily relying on CPU.
  • yougotkicked - Tuesday, June 4, 2013 - link

    As always, thanks for the great article and hard work Ian.

    I'd really like to see how a few of the tests scale with overclocked CPU's, notably those in which the sandy bridge processors were competitive with ivy bridge and haswell parts. Obviously overclocking introduces a lot of variables into your testing, but it would be very interesting to see a few of the popular choices tested (sandy bridge parts @ 4.5 are quite common, and many users on such a system were waiting for haswell before they upgrade).
  • eBombzor - Tuesday, June 4, 2013 - link

    Crysis 3 benchmarks PLEASE!!
  • frozentundra123456 - Tuesday, June 4, 2013 - link

    Interesting results, but very limited as well. Why test at a resolution used by only 4% of the players?

    I would have rather seen the results at 1080p, over a wider variety of games. Especially RTS games and newer games like crysis 3, FC3, and Tomb Raider. I tested Heart of the Swarm on my computer with a HD7770 and i5 2320 and was able to max out the cpu in a 10 player skirmish match at ultra, 1080p. So I am sure an A8-5600 would be limiting in that case.

    Even considering the results only of the games tested, the A8-5600k seems a strange choice. The i3 seems just as valid, considering it is equal or faster in every game but one, while using less power.
  • makerofthegames - Tuesday, June 4, 2013 - link

    Question - are those blank entries for the Xeons because they could not run, or just that data was not collected for them?
  • Awful - Tuesday, June 4, 2013 - link

    Glad to see there's no reason to upgrade the i5-2500k in my desktop yet - still happily chugging away at 4.9GHz after 2 years!
  • holistic - Tuesday, June 4, 2013 - link

    Ian,

    Thank you, for your time, effort, and energy in compiling an encyclopedic database on the effects of cpu on single and multi gpu configurations, in alternate gaming/engine scenarios. Your work is insightful, informative, and wholly devoted to the science of benchmarking. This approach has helped me, as a relatively new computer enthusiast, to more deeply understand testing methodology in the computing field.

    I am interested in the pure CPU benchmarks of Starcraft 2 with the 4770k and 4670k. I understand this game is not optimized, is directx9, and is extremely cpu limited with only 2 maximum cores active, and thus not in top priority for providing benchmarks. Will haswell be added to the benchmarking database for sc2?

    Cheers,

    Craig
  • khanov - Tuesday, June 4, 2013 - link

    Ian, I have to say (again) that i7-3820 should be in this review.
    You say that i7-4770K is a better value proposition than Sandy Bridge-E (X79), I assume because you are only thinking of the expensive 6 core X79 CPU's. That changes if you do consider i7-3820.

    X79 brings far better support for multi-gpu setups with enough PCIe lanes to feed multiple cards quite happily. No PLX needed. Pair that with an i7 3820 (cheaper than i7-3770K/i7-4770K) and you may find the performance surprisingly good for the price.
  • chizow - Friday, June 7, 2013 - link

    I considered the 3820 numerous times (it's cheap at MC, same price as high-end 3770K/4770K) but I shy away because it inexplicably performs *WORST* than 2700K/3770K/4770K. I don't know why, it has more L3 cache, and is clocked higher before/after boost. Just an oddball chip.

    Besides, X79 as a platform was dated almost as soon as it released. PCIe 3.0 support is spotty with Nvidia (reg hack not guaranteed), no native USB 3.0 and no full SATA 6G support. I went for Z87 + 4770K instead because X79 + 3820 didn't offer any noticeable advantages while carrying a significant higher price tag (board price).

Log in

Don't have an account? Sign up now