CPU Benchmark Performance: AI Performance

As technology progresses at a breakneck pace, so do the demands of modern applications and workloads. As artificial intelligence (AI) and machine learning (ML) become increasingly intertwined with our daily computational tasks, it's paramount that our reviews evolve in tandem. To this end, we have AI and inferencing benchmarks in our CPU test suite for 2024. 

Traditionally, CPU benchmarks have focused on various tasks, from arithmetic calculations to multimedia processing. However, with AI algorithms now driving features within some applications, from voice recognition to real-time data analysis, it's crucial to understand how modern processors handle these specific workloads. This is where our newly incorporated benchmarks come into play.

Given makers such as AMD with Ryzen AI, with multiple iterations including the XDNA 2 NPU within the Ryzen AI 9 HX 370, and Intel with their Meteor Lake mobile platform featuring AI-driven hardware, aptly named Intel AI Boost within the silicon, AI, and inferencing benchmarks will be a mainstay in our test suite as we go further into 2024 and beyond.  While there's currently no defacto benchmark for AI at the moment, we've compiled a couple of different benchmarks to gauge performance.

It's also worth noting that desktop processors don't really utilize NPUs, so all of the grunt in the below benchmarks is done using the CPU.

(6-2) DeepSpeech 0.6: Acceleration CPU

(6-3) TensorFlow 2.12: VGG-16, Batch Size 16 (CPU)

(6-3b) TensorFlow 2.12: VGG-16, Batch Size 64 (CPU)

(6-3d) TensorFlow 2.12: GoogLeNet, Batch Size 16 (CPU)

(6-3e) TensorFlow 2.12: GoogLeNet, Batch Size 64 (CPU)

(6-3f) TensorFlow 2.12: GoogLeNet, Batch Size 256 (CPU)

As we've previously stated, all of the AI benchmarks and models used use the CPU to do all the grunt work. In our DeepSpeech Mozilla-based speech-to-text engine, Zen 5 doesn't really do much against the competition, Although in TensorFlow with both GoogLeNet and VGG-16 models, Zen 5 is very competitive.

CPU Benchmark Performance: Rendering & Simulation Gaming Performance: 720p
Comments Locked

70 Comments

View All Comments

  • Golgatha777 - Wednesday, August 7, 2024 - link

    Thanks for the review. I personally would have liked to see a 7800X3D in the benchmarks. Also, I would have omitted 720p and replaced it with 1440p gaming benchmarks. 1080p is perfectly fine for a synthetic benchmark to see which CPU is faster overall and a lot of gamers run 1440p.
  • kpb321 - Wednesday, August 7, 2024 - link

    Agreed. The 7800X3D should be very close in price to the 9700X so having both in the gaming charts would be pretty nice. Offhand I assume it will be a mix. For standard game the 9700x should have a small lead due to the Zen 5 improvements. For things that are cache sensitive that will make the 7800X3D more competitive or even faster.
  • heffeque - Wednesday, August 7, 2024 - link

    It doesn't make sense.
    The 7800X3D should be compared to the 9800X3D (which will come in a few months).
  • Trackster11230 - Wednesday, August 7, 2024 - link

    It makes sense to compare the 7800X3D to the 9700X due to price, and I'm sure it'll be compared against the 9800X3D when it comes out too. These aren't mutually exclusive.
  • Klober - Wednesday, August 7, 2024 - link

    Seriously? Did none of you pay attention to the charts? There's clearly a 7800X3D in all but 2 of the charts on this page alone. I could maybe see an argument made for the 7900X3D (coincidentally, the CPU I have which I why I noted it's missing) but not the 7800X3D.
  • Trackster11230 - Wednesday, August 7, 2024 - link

    Yes, I see it in the charts, hence my comment about it making sense being in here. It's similar in price to the 9700X, so it makes sense to compare from that metric. What's so difficult to understand?

    I could make an argument too that an 8c/16t CPU makes more sense to compare to than the 7900X3D with 12c/24t.
  • boozed - Wednesday, August 7, 2024 - link

    Seems odd that the gaming CPU is missing from the gaming results
  • boozed - Thursday, August 8, 2024 - link

    "Note: We are currently benchmarking more processors as we speak"

    I should read harder
  • Oxford Guy - Friday, August 16, 2024 - link

    They said that they would re-test the Intel chips over the weekend in May. Did those updated benchmarks ever get done and published?
  • frshi - Wednesday, August 7, 2024 - link

    The table says Quad Channel DDR support, I don't think that's true. It's 4 slots but it's dual channel, isn't it?

Log in

Don't have an account? Sign up now