Performance Data

Because we were only able to get our hands on a release candidate version of WHS for the performance testing, all the results here need to be taken with a grain of salt. The WHS RC is quite good, especially in comparison to rockier launches like Vista, but we expect the performance numbers in particular to have changed slightly between the RC and the final version.

It's worth noting that the network packet throttling problem with Vista is still in play as of this writing. As a result all of our tests are under Windows XP SP2 unless otherwise noted, and when they're run on Vista it is with Multimedia Class Scheduler Service disabled to prevent throttling. Although this problem has existed in Vista since it has shipped, this is about the worst time it could come to light for Microsoft. Until it's fixed, Vista users wanting to move their media off of a personal computer and onto a WHS server will definitely want to hold off on doing so. Even though the problem with throttling isn't one with WHS, the problem occurring in Vista still drags down WHS.

Client Test Bed
Processor Intel Core 2 Quad QX6850
(3.00GHz/1333MHz)
RAM G.Skill DDR2-800 (2x2GB)
Motherboard Gigabyte GA-P35-DR3R (Intel P35)
System Platform Drivers Intel 8.1.1.1012
Hard Drive Maxtor MaXLine Pro 500GB SATA
Video Cards 1 x GeForce 8800GTX
Video Drivers NV ForceWare 163.44
Power Supply OCZ GameXStream 700W
Desktop Resolution 1600x1200
Operating Systems Windows Vista Ultimate 32-Bit
Windows XP SP2
.

Server Test Bed
Processor AMD Athlon X2 4600+
(2.40GHz/400MHz)
RAM OCZ DDR-400 (4x512MB)
Motherboard ASUS A8N-SLI Premium (nForce 4 SLI)
System Platform Drivers NV 6.69
Hard Drive 2x Western Digital Caviar Raid Edition 2(400GB)
Power Supply OCZ GameXStream 700W
Operating Systems Windows Home Server RC
.

We'll start with testing WHS's file server abilities by transferring files back and forth. With a gigabit network, the bottleneck will be the transfer abilities of our hard drives, so if WHS is achieving maximum performance it should be able to move data at speeds around the maximum of our hard drives. We'll be using a RAM disk on the client side to isolate the performance of WHS.

Also on this graph will be the performance of WHS while attempting to do file transfers in the middle of a balancing operation. Because of the importance in balancing data for data retention and performance reasons, WHS will sometimes need to balance folders even during times of backups and file transfers. This doesn't seem very common in our use since it's related to total use of the WHS server, but it needs to be noted all the same. WHS does seem to take steps to avoid balancing during heavy use when possible.

At 53MB/sec up and 67MB/sec down, the results are very close to those that we've seen WD RAID edition hard drives do previously. For users with gigabit networks, it looks like it's very possible for WHS to offer performance virtually equal to having the drives installed locally. Speeds while balancing aren't very impressive though, not that we expected them to be.

The other metric of WHS's performance is how it handles backups. Unlike pure file transfers, backups aren't "brain-dead" operations and require work on behalf of both the server and the client. The client needs to figure out what data is to be sent to the server, and the server is responsible for keeping all of that data organized and compressed. WHS backup performance is also heavily dependent on what else is already in the backup cache, because WHS avoids backing up anything redundant down to the cluster level.

These specific tests were run with empty caches as a worst-case scenario; actual performance of the initial backup on a new machine (as long as it's not the first machine) should be faster. These tests are being done on clean Windows installations, with the second "incremental" backup being done immediately after the first backup completes. This is more optimistic than a real incremental backup since virtually no data changes, but in doing it this way we can establish a floor for approximately how long the scan process takes. The reference sizes for these installations are 2.3GB for XP and 5.4GB for Vista, after factoring out the system page file and other files that WHS backup filters out.

Both Vista and XP turn in respectable, although not amazing backup times. Using the incremental backup as the baseline, we achieved an average backup speed of about 20MB/sec. This is well below what we've seen on our file transfer tests, but still fast enough to complete these backups in a short amount of time; since WHS doesn't have any true peers we don't have anything else to properly compare it to. In an actual deployment with real incremental backups and common data, we expect the results to be a lot closer to that of the incremental times.

We also took the liberty of backing up the XP machine again once the Vista machine was backed up in order to measure the size of the backup cache on the WHS server. Even with these clean installs, there's about 2GB of savings on the WHS server; 7.7GB of data is only taking up 5.7GB of space. Like Previous Versions on Vista, these savings should grow as more data is added to the backup cache.

WHS As A Webserver/Gateway/Everything Else Initial Thoughts
Comments Locked

128 Comments

View All Comments

  • mindless1 - Wednesday, September 5, 2007 - link

    Ok, but want kind of soft-raid "needs" windows? I've dealt with several different soft raid controllers and windows official "support" is not needed, except for a management utility application if desired, to show the state of the arrays. While the management utility could be used to rebuild arrays, assign spares, etc, (in some cases), this is only supplimental to what functionality is provided in any typical soft-raid bios.

    Remember, windows can be installed onto a soft-raided volume. Soft raid doesn't depend on windows. There might be something about WHS that I haven't considered yet that would be a limitation but in general I find the article's conclusion that "not supported" means "won't work" to be odd. I think it more like when a cable ISP tells you that your router isn't "supported" meaning you're just on your own if you do it, they make no guarantee your unique configuration will or won't work.

    Let me put it another way, I am wondering if anyone has any example of a soft raid controller that can't be set up prior to OS installation, it's a pretty manditory feature if you want that OS on the RAIDed volume. What remains is a driver support for the controller in windows but any product with a Win2k3 driver should work unless MS has gone and deliberately castrated WHS. Likewise with a soft raid management utility, unless it's using a fancy installer which refuses to install due to not identifying the WHS OS.

    What I suspect is that MS simply disabled the OS integral raid functionality which would be used with drives NOT in any kind of raid controller (soft or hardware), raid configuration. If this is the case, someone will probably hack it to regain that functionality, and it might not even be anything more than a registry change needed.
  • leexgx - Tuesday, September 4, 2007 - link

    the idea if WHS is to be easy to use
  • ATWindsor - Tuesday, September 4, 2007 - link

    And? The simple functions can be easy to use, while at the same time having more advance features available if one turns them on.

  • leexgx - Tuesday, September 4, 2007 - link

    i assume thats what the add-ons are for later on when thay get made

    if an hdd failes or is about to on WHS it auto start balancing to an other disk thats Online and ok there is allways two copys if its turnd on (duplication)
    not not sure how to degrade an disk but i assume it try and move the data off it i know it will if you remove the problem disk Useing WHS connector as its part of the wizard when removeing disks

    the idea of WHS is for users who have limited lerning curves (Plug in expect it to work basicly)

    nothing stopping you from making RAID 5 on WHS but it not work correctly in WHS connector
  • mindless1 - Wednesday, September 5, 2007 - link

    The problem is that it is not real-time mirroring, since it waits until later to make the second copy, odds are you would end up losing something if a drive fails.

    I don't understand when people claim the idea here is "easy". What's so hard about plugging in two hard drives, entering a bios menu and assigning the two to an array? That's an order of magnitude easier than becoming accustomed to a new OS, setting it up. If the idea is just plug it in and expect it to work, then you will NOT HAVE that redundant second copy of the data you're implying is sufficient. These are fairly important features on a fileserver, and then if you want dynamic virtualized volumes that would be yet another feature so you can pick what you want to do, just like it is now with other windows versions where it is easy if you just accept the defaults, most basic config., but you don't have to accept the defaults.
  • leexgx - Wednesday, September 5, 2007 - link

    if

    as windows home server its an little lame that you cant use the Boot drive on hardware RAID 1 (boot disk for some resone Cant be SCSI drivers){Sata in raid or IDE RAID} as if the boot disk fails thats an big problem as there is no redundancy for it

    it more likey work after windows has been installed but its gettings WHS to Boot off an raid array after its been ghosted over all i can see is getting the driver to load up

    quote:

    To lose data 3 conditions would have to be met:
    1. Have to lose primary drive in WHS

    nope its stored on other disk that has been duplication as long as it has all ready been done if not you lose any new data thats just been put on (it have to be with in last 10secs to 1 min if it was an small file) unlakey that happen

    you can take the disks out and mount them as each disk uses norm NTFS file system just needs an drive letter putting on
  • tynopik - Wednesday, September 5, 2007 - link

    > as windows home server its an little lame that you cant use the Boot drive on hardware RAID 1 (boot disk for some resone Cant be SCSI drivers){Sata in raid or IDE RAID} as if the boot disk fails thats an big problem as there is no redundancy for it

    that is an annoyance for recovering the WHS, BUT if you were duplicating data, your data is still safe on another drive

    > nope its stored on other disk that has been duplication as long as it has all ready been done if not you lose any new data thats just been put on (it have to be with in last 10secs to 1 min if it was an small file) unlakey that happen

    it was very difficult to follow what what you're saying, but i think we both have the same understanding of how it works

    note i said ALL 3 conditions have to be met
    i agree losing primary drive alone will not mess up duplication, UNLESS condition 2 is ALSO met
    condition 2 is what you said, it fails before it had a chance to copy to the secondary drive, which i agree is very unlikely
  • tynopik - Wednesday, September 5, 2007 - link

    > The problem is that it is not real-time mirroring, since it waits until later to make the second copy, odds are you would end up losing something if a drive fails.

    1. it doesn't wait that long, you wouldn't lose much
    2. odds are you won't lose anything

    don't forget this is the BACKUP system, even if the BACKUP fails, your primary should still be ok.

    To lose data 3 conditions would have to be met:
    1. Have to lose primary drive in WHS
    2. (1) would have to occur in the narrow window between when it being copied to WHS and a duplicate is made onto another HD
    3. Have to lose ANOTHER drive in a COMPLETELY DIFFERENT system (the one the file was originally on)

    personally i would be more worried about the time between when a file is created/modified on your system and it is copied to WHS in the first place.

    Assuming backup runs at night and you create a file in the morning, that's almost a whole working day of exposure when the file is in ONLY one place

    > What's so hard about plugging in two hard drives, entering a bios menu and assigning the two to an array?

    having to limit yourself to the lowest common denominator of your drives

    let's say you have a 200gb, a 200gb and a 400gb drive and you put it in a raid, you're wasting half the capacity of the 400gb. With WHS you could store a full 400gb with duplication.
  • mindless1 - Thursday, September 6, 2007 - link

    Are you joking? I don't know what you think passes for reliable redundancy, but the idea that you're playing "odds" and then relying on a client not failing to keep your fileserver stores intact is crazy.

    This isn't a "backup", this is a "server", which for many people will be more important than their clients.

    Let's say you don't put a 200GB, 300GB and 400GB in a Raid, since you seem to be trying hard to cause a problem then thinking WHS would bail you out of ineptitude. The only thing hard about a server is when people make excuses not to use the time tested proven reliable strategies then try to excuse it with examples of bad choices. It is a very trivial thing to set up a home file server, far far quicker and easier than even a typical desktop WinXP system tweaked for a particular user's preferred environment. Trying to suggest there are problems is a sign you just don't understand this.

    For lower cost, any system can be made into a fully redundant fileserver that is more reliable, not in beta OS state, and has more storage until there is at least $360 more spent on drives. This 360 figure comes from 2x the initial $180 projected price of WHS.

    WHS will be a good option once 3 things are addressed:

    1) The price is too high for the small increase in functionality over what can be added as freeware or very low cost add-on to Win2k or XP.

    2) WHS matures more. I didn't run anything mission critical on any MS OS when it first came out, that would be foolish for an important fileshare. That it is derived from Win2K3 bodes well for it, but the very features being suggested as important by some, are the very features that are new enough to still have some beta-release related issues and need patched later.

    3) It is limiting in user choice of configuration. As OS is not supposed to tell you what to do, rather enabling you to do what you want to do.
  • tynopik - Thursday, September 6, 2007 - link

    > This isn't a "backup", this is a "server", which for many people will be more important than their clients.

    if your only/main purpose in getting this is as a server, then yes, perhaps WHS isn't for you

    it's most powerful/compelling feature is it's backup system. sure it can do other things, but if you aren't using that then there's not a whole lot of reason to use it

    just because backup of clients isn't a big deal to you doesn't mean it isn't a big deal to others

    just because WHS doesn't meet YOUR needs doesn't mean it's stupid, it just means it's not for you

    for me backing up clients is very critical and WHS looks like a godsend

    oh really?

    please tell me where i can find a backup system as flexible and powerful as this at no cost

    > For lower cost, any system can be made into a fully redundant fileserver that is more reliable, not in beta OS state, and has more storage until there is at least $360 more spent on drives.

    tell me which free system provides ALL of the following features and i will gladly jump on board

    - autocombine all physical disks into 1 volume
    - disks can be any size
    - disks can be added or removed at will
    - yet still have physical redundancy of files on different drives
    - automatically save single instance of identical files/blocks to reduce space wastage
    - automatically preserve previous versions
    - do live imaging of windows systems that can then be restored from bare metal with just a boot cd and a network connection

    sure parts of it can be duplicated for free, but do tell how you would setup something that does ALL that

    (just as a quick aside, a basic server just sitting there is going to waste a TON of space backing up multiple windows systems from all the redundant files. Oops, there goes all your extra space)

Log in

Don't have an account? Sign up now