Encoding and Network Benchmarks

AutoGK

Our encoding benchmarks will use AutoGK with two different video files. We'll encode with both the DivX and Xvid codecs. Our movie encoding benchmark uses a chapter from The Sum of All Fears, and we encode it to 75% quality with no audio and the video size set to "Auto". In this test, Auto results in a 720x384 video clip. This is the most simplistic of video encoding tasks, as the 75% quality only requires a single pass. All tests were done with version 1.60 of AutoGK - the latest official release at the time that benchmarking was started. Version 1.96 is now available, but a quick test didn't show more than a 2% difference in performance.

Our second encoding benchmark uses an MPEG-2 file that we created using the high quality TV input option from the Aopen EA-865-II. We took the 28MB file (for a 30-second clip) and set the target size to 5 MB. The encoding takes three passes: a compression analysis pass followed by two encoding passes. We report the total time required from the instant that we press the Start button to the conclusion of the second encoding pass. Video size is set to a fixed width of 640 pixels (i.e. no loss in video size) and audio was set to auto (which results in MP3 encoding). (If you prefer to compare frames per second, the video is 900 frames long, so divide by the time reported in our graphs.) Audio processing with multiple video passes slows the FPS down dramatically in comparison to the single pass test, of course.

You can check out the samples of the DivX and Xvid encoded video files if you're interested. When compared with the 28MB MPEG-2 source file, the benefits of re-encoding are readily apparent.

AutoGK 1.60 - DivX 5.2.1 Encoding

AutoGK 1.60 - Xvid 1.0.3 Encoding

AutoGK 1.60 - DivX 5.2.1 Encoding

AutoGK 1.60 - Xvid 1.0.3 Encoding

Most of the systems are very close in performance. The 330P presents an interesting picture, with the fastest score in the single pass DivX test and the slowest score (for 939) in the multi-pass DivX test. We're not sure why the results vary so much, since both tests use DivX and we had the System Control utility running.

Networking

In order to test network performance, we used the NTTCP utility from the Windows 2000 Driver Development Kit. This is less prone to variance than the simple file copy that we used in the 478/754 roundup, though the results become more of a theoretical maximum than a representation of normal use. In most networking situations, you'll be limited by the performance of your hard drive - at least, if you're planning on using these SFFs. High Performance Computing can make good use of faster networks, but that's a different topic. We executed the following command at a Command Prompt on each system:

ntttcpr.exe -m 4,0,[Server IP Address] -a 4 -l 256000 -n 30000
ntttcps.exe -m 4,0,[Client IP Address] -a 4 -l 256000 -n 30000


We ran each of the systems as both a client and a server, connected through a gigabit switch. Our companion PC for this test is an Athlon 64 3200+ system in an MSI K8N Neo Platinum motherboard. The reason for that choice is because it's my personal PC, so it's not as likely to be in a disassembled state as the other systems around the labs. This makes the results a bit more "real world" than a crossover cable, but we're not too concerned - we just want a baseline estimate of networking performance. Since all of the networking chips are gigabit Ethernet, we should in theory see results close together. Reality disagrees with that assumption, though.

Network Performance - Client

Network Performance - Client

Network Performance - Server

Network Performance - Server

The variation in theoretical networking performance is pretty large, with the fastest client tested being the SN25P at 925.41 Mbps and 31.17% CPU load. The slowest client is the ST20G5, coming in at 629.87 Mbps and 15.8% CPU load. The spread among the networking controllers when functioning as a client is 47%. Notice how the CPU usage is directly reflected in performance, however: faster networking on these solutions all results in more CPU time. High end networking solutions would offload a significant amount of the CPU load onto the controller, but that is almost exclusively the domain of servers.

The interesting thing is that client performance seems to have very little relation to server performance, at least with the NTTCP utility. The fastest server is also the SN25P, actually surpassing its client score with 943.89 Mbps and 37.98% CPU load. The second fastest is the 330P, with a similar performance advantage over its client scores. What's interesting is the ST20G5, coming in at 835.92 Mbps with 32.6% CPU load - this despite being the slowest client. Note that the CPU load of the ST20G5 was almost twice as high when functioning as a server instead of a client. The difference in server performance is slightly higher than the spread in client performance: 53%.

Clearly, all gigabit Ethernet controllers are not created equal. Unfortunately, if networking performance is critical for your system use, we really don't have much to offer in the way of advice beyond stating that the SN25P and 330P seem to be the best implementations - likely helped by placing the NIC on the PCIe bus. There isn't a clear pattern among the remaining systems, as the ST20G5 also uses a PCIe network chip. The drivers are obviously important in realizing the maximum performance of the network solution. In everyday network use, though, the performance difference is not generally noticed: streaming movies, copying files, etc. all use far less than even the 630 Mbps of performance that the ST20G5 provided.

We did try to run some duplex tasks - i.e. having the system function as both client and server at the same time while another system was server and client. That should have pushed us over the 1 Gbps rate for total network traffic, and it could have made the non-PCI networking options stand out, as the PCI bus is limited to 133 MBps. Our attempts at getting a repeatable test failed, however, as CPU usage and network traffic varied wildly. The (cheap) network switch that we used may have played a role, and CPU multitasking likely had a part as well, but we didn't feel that it was worth pursuing the matter further.


Click to enlarge.

Finally, if anyone thought that the switch or K8N system would limit performance, the performance of the SN25P should assuage your fears - we're very near the theoretical maximum of GbE! We didn't realize in advance that the nF3Gb chipset in the K8N could perform this well, but lucky for us that it did. We grabbed a screenshot of the two networking passes on the 330P in task manager, showing how close we are to 100% network utilization. The SN25P is even closer to 100% GbE utilization.

Business Benchmarks Gaming Benchmarks
Comments Locked

29 Comments

View All Comments

  • JarredWalton - Wednesday, August 10, 2005 - link

    So I spoke too soon. After finishing this article, I just happend to come across http://www.newegg.com/Product/Product.asp?Item=N82...">the new Aopen 939 SFF. That actually looks pretty promising, though the IGP isn't going to beat the ST20G5 that I can see (no DVI port). Time to put in a request for that unit....
  • rqle - Wednesday, August 10, 2005 - link

    Price of these SFF are getting quite pricey lately. So much to the point when you add the cpu, hard drive, memory, video card, optical drive AND LCD it will comes very close to the price of a good high end laptop on a good day. Dell 17inch 9300 w/6800 on a VERY good sale day comes just over the price of these SFF 'system.' Big fan of these SFF, but prices should be a little bit more reasonable for me to buy again.
  • JarredWalton - Wednesday, August 10, 2005 - link

    I agree with you on a lot of that, but a SFF with a 19" (or larger) LCD and a 6800GT/X800XL is pretty much going to stomp all over any similarly priced laptop. There's basically a $150 price premium to get a high-end SFF case, which is going to prevent many from buying. Still, some people buy $200 cases just because they look nice, so it's all a matter of taste.

    If you need portability, though, there are very few options other than getting a laptop. Personally, laptops and gaming are something I just don't care about. I'd get a cheap laptop for the office work I do and then keep a second system at home for any gaming. Some of course feel otherwise, but laptop keyboards and such just don't do it for me.
  • R3MF - Wednesday, August 10, 2005 - link

    love it.
  • BigT383 - Wednesday, August 10, 2005 - link

    I have a first-generation SN95G5. I bought it thinking that since it's socket 939 I'd be able to upgrade to dual-core when it came out.

    Apparently this isn't the case, but I haven't seen anybody say they've tried it yet- so far there seem to be only rumors.

    So I know this is a weird request but what I'd like to see right now is an article testing a CPU like the Athlon X2 4400+ on the three different versions of the SN95G5.

    I can understand that X2s need a bios update, but the physical motherboard shouldn't be holding me back, right?
  • dcuccia - Thursday, August 18, 2005 - link

    X2 support for the SN25P w/o USB2 issues is now available through a BIOS upgrade:

    http://www.shuttle.com/share/fae/hq/download/bios_...">http://www.shuttle.com/share/fae/hq/download/bios_...

  • JarredWalton - Thursday, August 18, 2005 - link

    Thanks, I made a quick comment on the SN25P page to mention this.
  • JarredWalton - Wednesday, August 10, 2005 - link

    I'm going to be dropping an X2 3800+ into the SN95G5v2 just to see what happens. I'll try to get some official word from Shuttle on the matter as well. I really have no idea what the SN95G5v1 will support. I think the main change between it and v2 was a switch from an 80mm fan to a 92mm fan.
  • Zirconium - Wednesday, August 10, 2005 - link

    I love the roundup articles. I find them to be the most useful because they allow you to hone in on what you are looking for quickly, and then you can go to other sites and check the reviews that are solely for the products you are looking for.

    That said, one thing I'm interested is the quality of the integrated graphics on these computers. I have an SK41G and I could tell the difference between the quality of the built-in graphics and the AIW Radeon 7500 that is currently in it. When the integrated graphics were hooked up to a TV (I tried two) you could notice bands moving up the TV.

Log in

Don't have an account? Sign up now