As mentioned earlier, if this was a $329 Windows 8 notebook, it would be considered severely compromised, especially compared to notebooks priced closer to $500. When we heard about the presence of a mechanical disk, we wondered what sort of an impact this would have on performance. The embedded SSDs we're used to in Chromebooks don't exactly offer breakneck speeds, but we've shown time and again that there is often a performance difference of several orders of magnitude between the fastest mechanical drives and the slowest modern SSDs. Thankfully, we're never lacking in NAND-based storage, so we swapped in an idle 120GB OCZ Agility 3. Most of our suite of web tests can live comfortably in RAM, and with nothing but Chrome as our platform the user really shouldn't ever experience how slow the mechanical drive is really, except in boot times.

Acer C7 Chromebook HDD v. SSD
HDD SSD % Delta
Sunspider (in ms) 527.1 499.4 5.26
Browsermark 2.0 3403.7 3356.7 -1.38
RIABench Focus-tests (in ms) 1193.7 1185.7 0.67
Kraken (in ms) 6817.2 6758.7 0.86
Bubbles (fps) 19 19 0
Fishbowl (fps) 17 16 -5.88
Maze Solver (in s) 17 17 0
Solar System (fps) 31.67 31.0 -2.11
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46

The only difference of statistical significance is the WebGL Aquarium test. Like all operating system's, Chrome OS relies on a page file on local storage for those occasions where memory is insufficient for the active tasks. Typically you would see inactive bits shuttled into the page file and then recalled to memory when RAM is available and those particular bits are necessary. We run our test suites with no other programs or browser instances running, so anything that spills over to local storage is the result of that 2GB RAM limitation. The WebGL Aquarium test is bulky enough that it spills into the cache and the result is a huge increase in performance when an SSD is used. How does this difference manifest in the real world? Most likely users might perceive some speed increase when swapping between tabs, and better boot times. So if the HDD doesn't do much for performance, what about the RAM? The C7 comes with a scant 2GB of memory, on a single SO-DIMM; that's well below what we'd recommend for even the most budget notebook experience in Windows or OS X, but perhaps enough for the small footprint of Chrome OS. Let’s find out if it’s enough by swapping the single SO-DIMM for a pair totaling 4GB.

Acer C7 Chromebook 2GB v. 4GB
2GB 4GB % Delta
Sunspider (in ms) 527.1 500.3 5.03
Browsermark 2.0 3403.7 3334.0 -2.05
RIABench Focus-tests (in ms) 1193.7 1218.7 -2.09
Kraken (in ms) 6817.2 6617.1 2.94
Bubbles (fps) 19 19 0
Fishbowl (fps) 17 17 0
Maze Solver (in s) 17 18 5.88
Solar System (fps) 31.67 32.33 2.11
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46


Acer C7 with back cover removed, 2x2GB SO-DIMM installed

The data is quite reminiscent of the deltas we saw after swapping in the SSD, and that validates the suspicion that even in our test environment, 2GB of RAM can be overwhelmed quickly and the device can end up hitting local storage more than we'd like. By raising memory to 4GB we still see negligible performance changes in the majority of tests, but a huge increase in the Aquarium test.

There's more to it than synthetics, though. We're used to having an excess of browser tabs and windows open at once here at AnandTech. My workflow generally involves at least three windows, and several tabs in each, and I may hop between many tabs in quick succession to look through research or move between GMail and Google Reader or Twitter. While working with the stock configuration it wasn't uncommon to have tabs I had just moved away from refresh when I moved back to them. At first I wondered if this was an expected response, an effort by Chrome to ensure that the most current content was presented to the user, but this strategy seemed foolish in too many instances to make it logical. Take for instance shopping; if you're working on a computer configuration, it would be a nuisance to have to repeat your selections whenever you switch tabs, triggering a refresh. What became clear once I'd switched to the 4GB configuration was that the behavior was really related to memory capacity. When a tab is moved from memory to the local disk, a flag is tripped telling Chrome to refresh the content when the user returns to it. With an appropriate amount of memory the only tabs that would end up in local storage would be ones that hadn't been accessed for quite a while. Here, though, the tabs end up getting refreshed every time they are accessed. From a user perspective it was night and day; one configuration could hardly handle a half dozen tabs, the other seemed unfazed by my regular workflow.

So, more memory and better storage are all it takes to juice up the C7, right? Not quite. The single biggest performance improvement required just a few clicks. Just as Google is constantly pushing updates to the Chrome browser, Chrome OS is frequently updated and several build channels are available. We did all of our testing on the Stable channel, which sees fewer updates than either the Beta or the Unstable (Dev) channels. Performance and stability tweaks will be the most common aims for updated dev builds, though occasionally features may be added to the Dev channel and slowly make their way to the Stable builds. So, how does the Dev build compare to Stable?

Acer C7 Chromebook Stable v. Dev Build
Stable Dev % Delta
Sunspider (in ms) 527.1 512.4 2.79
Browsermark 2.0 3403.7 3561.7 4.64
RIABench Focus-tests (in ms) 1193.7 1260.3 -5.59
Kraken (in ms) 6817.2 6411.8 5.95
Bubbles (fps) 19 14 -26.3
Fishbowl (fps) 17 39 129.4
Maze Solver (in s) 17 18.7 9.8
Solar System (fps) 31.67 28 -11.6
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46

Often, when software is tweaked for performance in one area, it's at the expense of performance in others. Here you see some marginal improvements in JavaScript performance, and some enormous improvements in tests that leverage the GPU. The increase in the HTML5 Fishbowl test is enormous and likely indicates that the Stable build doesn't feature GPU acceleration for the HTML5 techniques being used. A loss in performance in the Bubbles test could indicate that other changes to the JavaScript engine limited performance in some elements. When you look at the WebGL tests, the results show a clear improvement in GPU performance, despite the negligible drop in performance in the Solar System test.

In addition, the Dev channel features options for extending the OS's desktop onto a second display, though I'm not sure the utility, except for those that often need to see two browser windows side by side and are hampered by the limited screen space. So are their any deficits to using the Dev build? During testing the Dev build featured no major instability and had no lock-ups or other hinky behavior. So, ultimately, my only complaint with switching to the Dev channel is that returning to the stable channel requires a full recovery.

Performance: Core vs. ARM A15 Battery Life and Conclusion
Comments Locked

63 Comments

View All Comments

  • Andrew911tt - Monday, January 21, 2013 - link

    The people who read this site would never buy this as a replacement for their main device so there is no need to look at how your daily work flow would not work on this device and make it go cry in the corner.

    People are looking at this as a second device. I have a great desktop with two monitors and all the bells and whistles if I need to get work done. My second device is a old dell laptop that use in front of the couch or in bed that is the device that this was meant to be/replace.
  • StormyParis - Monday, January 21, 2013 - link

    The people who read this site act as advisers for many people who might want/need such a machine as a primary PC.
  • Andrew911tt - Monday, January 21, 2013 - link

    And any person who would consider this as a primary machine don't have that type of work flow
  • phillyry - Monday, January 21, 2013 - link

    I'd have to agree with StormyParis.

    I've actually been considering getting one of these things for my dad as a primary PC simply because he could still check his mail and do his banking while, at the same time, it would be difficult for him to mess it up.

    So, let's not make too many assumptions about the readers. We don't all fit your personal usage style or preconceptions.
  • Andrew911tt - Monday, January 21, 2013 - link

    You are making my point the person who ends up with it is going to be using it very sparingly. Your dad is not going to have the work flow that is described in the article, if would be much more facebook and email.
  • JasonInofuentes - Monday, January 21, 2013 - link

    So, I think you'd be surprised how many writers see the appeal of the Chromebook. Writing is often a matter of focus. Eliminate distractions and pull together only the resources you need to get the job done. Browser-based publishing tools are polished enough that several of us are actually using them exclusively, including some that even do image manipulations entirely in the browser.

    So, the Chromebook as a primary device has a lot of appeal.
    What I was trying to make clear is how it falters despite having plenty of potential. I have no doubt that as the performance of Chromebooks improves, and as browser-based publishing and media tools become more capable, that I could move to a Chromebook as a primary writing device. I'd still need a better equipped device for a lot of the benchmarking we do, but it'd very much end up being the second device.
  • jabber - Tuesday, January 22, 2013 - link

    I have the Samsung on order to test out and have just bought a Business Google Apps account.

    I have been talking to a lot of the folks in my small business networking circle and they are really interested in it.

    All they need is basic word processing and spreadsheet capability. A group calendar and scheduling. All the documents backed up and centrally stored. Pretty perfect for a lot of small businesses.

    That and the cost per user is £2.75 a month! If you have a lot of temp staff passing through you just give them a standard App account and then reset the password when they leave.

    That and the lack of virus, not having to buy Office and the low cost of the locked down kit. Support costs are lower.

    For a lot of businesses its a no-brainer.
  • Alexvrb - Monday, January 21, 2013 - link

    Correction: Any person who would consider this as a primary machine doesn't have ANY work flow. Flow sure, but work not so much.

    You said it yourself, people are looking at this as a second device to complement a real computer. But at that point, I think most people would be happier with a tablet as a second device.
  • silverblue - Tuesday, January 22, 2013 - link

    What if you were a author and wanted something cheap and not too small?
  • silverblue - Tuesday, January 22, 2013 - link

    'an', rather... I did put writer before, hence the 'a'.

Log in

Don't have an account? Sign up now