Motherboards Memory Storage Cases/Cooling/PSUs IT Computing Displays Mobile Mac CPUs & Chipsets Video Digital Cameras Linux Gadgets Systems Trade Shows Guides Home Increase Font Size Decrease Font Size Change Page Size
NVIDIA's Fermi: Architected for Tesla, 3 Billion Transistors in 2010
NVIDIA's Fermi: Architected for Tesla, 3 Billion Transistors in 2010
Date: September 30th, 2009
Topic: Video Card
Manufacturer: NVIDIA
Author: Anand Lal Shimpi
Buy the Sapphire 100282SR HD5850 Video Card
Blank
 Newegg $299.99
 Amazon $307.86
 CompUSA $299.99
 
 

ECC Support

AMD's Radeon HD 5870 can detect errors on the memory bus, but it can't correct them. The register file, L1 cache, L2 cache and DRAM all have full ECC support in Fermi. This is one of those Tesla-specific features.

Many Tesla customers won't even talk to NVIDIA about moving their algorithms to GPUs unless NVIDIA can deliver ECC support. The scale of their installations is so large that ECC is absolutely necessary (or at least perceived to be).

Unified 64-bit Memory Addressing

In previous architectures there was a different load instruction depending on the type of memory: local (per thread), shared (per group of threads) or global (per kernel). This created issues with pointers and generally made a mess that programmers had to clean up.

Fermi unifies the address space so that there's only one instruction and the address of the memory is what determines where it's stored. The lowest bits are for local memory, the next set is for shared and then the remainder of the address space is global.

The unified address space is apparently necessary to enable C++ support for NVIDIA GPUs, which Fermi is designed to do.

The other big change to memory addressability is in the size of the address space. G80 and GT200 had a 32-bit address space, but next year NVIDIA expects to see Tesla boards with over 4GB of GDDR5 on board. Fermi now supports 64-bit addresses but the chip can physically address 40-bits of memory, or 1TB. That should be enough for now.

Both the unified address space and 64-bit addressing are almost exclusively for the compute space at this point. Consumer graphics cards won't need more than 4GB of memory for at least another couple of years. These changes were painful for NVIDIA to implement, and ultimately contributed to Fermi's delay, but necessary in NVIDIA's eyes.

New ISA Changes Enable DX11, OpenCL and C++, Visual Studio Support

Now this is cool. NVIDIA is announcing Nexus (no, not the thing from Star Trek Generations) a visual studio plugin that enables hardware debugging for CUDA code in visual studio. You can treat the GPU like a CPU, step into functions, look at the state of the GPU all in visual studio with Nexus. This is a huge step forward for CUDA developers.


Nexus running in Visual Studio on a CUDA GPU

Simply enabling DX11 support is a big enough change for a GPU - AMD had to go through that with RV870. Fermi implements a wide set of changes to its ISA, primarily designed at enabling C++ support. Virtual functions, new/delete, try/catch are all parts of C++ and enabled on Fermi.

The RV770 Lesson (or The GT200 Story)   Next Page

 
  Index

Tools Share
Find lowest prices Find the lowest prices
Digg   del.icio.us   E-mail  
Print This Article Print this article  

170 Comments - Last by adilakkus, 102 days ago
Username:
Password:
Thank you for the proper quote from Nvidia by Lord 666, 131 days ago
That actually just made my day; seeing a VP of Marketing speak their mind.

Reply
RE: Thank you for the proper quote from Nvidia by therealnickdanger, 131 days ago
Agreed. That was refreshing!

Reply
RE: Thank you for the proper quote from Nvidia by mapesdhs, 131 days ago

Blimey, I didn't know Ujesh could utter such things. :D When I knew
him in 1998 he was much more offical/polite-sounding (he was Product
Manager for the O2 workstation at SGI; I was using a loaner O2 from
SGI to hunt for OS/app bugs - Ujesh was my main contact for feedback).

The poster who talked about availability has a strong point. My brother
has asked me to build him a new system next week. Looks like it'll be
an Athlon II X4 620, 4GB RAM, 5850, better CPU cooler, with either an
AM3 mbd and DDR3 RAM or AM2+ mbd and DDR2 RAM (not sure yet). By heck
he's going to see one hell of a speed boost; his current system is a
single-core Athlon64 2.64GHz, 2GB DDR400, X1950Pro AGP 8X. :D My own
6000+ 8800GT will seem slow by comparison... :|

Ian.



Reply
RE: Thank you for the proper quote from Nvidia by samspqr, 131 days ago
ATI's availability will be sorted out soon, NVIDIA's weird design choices that are targeted at anything but graphics won't

in fact, I have just realized: NVIDIA IS DOING A MATROX!
(forget about graphics, concentrate in a proffessional niche, subsequently get run over by competitors in its former main market... eventually dissappear from the graphics market or become irrelevant? with some luck, RayTracing will be here sooner rather than later, ATI will switch to GPUcomputing at the right time -as opposed to very much too soon-, and we will have a 3 players market; until then, ATI domination all over)

Reply
RE: Thank you for the proper quote from Nvidia by Yojimbo, 131 days ago
What makes you think it isn't the right time? You can only really tell in hindsight, but you give in your post any reason that you think now is not the right time and later, when amd is gonna do it, is the right time. I think the right time is whenever the architecture is available and the interest is there. Nvidia has, over the past 5 years, been steadily building the architecture for it. Whether the tools are all in place yet and whether the interest is really there remains to be seen.
It has nothing to do with matrox or any shift to a "professional niche." Nvidia believes that it has the ability to evolve and leverage its products from the niche sector of 3d graphics into a broader and more ubiquitous computing engine.

Reply
RE: Thank you for the proper quote from Nvidia by wumpus, 130 days ago
Do you see any sign of commercial software support? Anybody Nvidia can point to and say "they are porting $important_app to openCL"? I haven't heard a mention. That pretty much puts Nvidia's GPU computing schemes solely in the realm of academia (where you can use grad students a cheap highly-skilled labor). If they could sell something like a FEA package for pro-engineer or solidworks, the things would fly off the shelves (at least I know companies who would buy them, but it might be more a location bias). If you have to code it yourself, that leaves either academia (which mostly just needs to look at hardware costs) and existing supercomputer users. The existing commercial users have both hardware and software (otherwise they would be "potential users"), and are unlikely to want to rewrite the software unless it is really, really, cheaper. Try to imagine all the salaries involved in running the big, big, jobs Nvidia is going after and tell me that the hardware is a good place to save money (at the cost of changing *everything*).

I'd say Nvidia is not only killing the graphics (with all sorts of extra transistors that are in the way and are only for double point), but they aren't giving anyone (outside academia) any reason to use openCL. Maybe they have enough customers who want systems much bigger than $400k, but they will need enough of them to justify designing a >400mm chip (plus the academics, who are buying these because they don't have a lot of money).

Reply
RE: Thank you for the proper quote from Nvidia by samspqr, 130 days ago
Well, I do HPC for a living, and I think it's too early to push GPU computing so hard because I've tried to use it, and gave up because it required too much effort (and I didn't know exactly how much I would gain in my particular applications).

I've also tried to promote GPU computing among some peers who are even more hardcore HPC users, and they didn't pick it up either.

If even your typical physicist is scared by the complexity of the tool, it's too early.

(as I'm told, there was a time when similar efforts were needed in order to use the mathematical coprocessor...)

Reply
RE: Thank you for the proper quote from Nvidia by jessicafae, 128 days ago
Fantastic article.

I do bioinformatics / HPC and in our field too we have had several good GPU ports for a handful for algorithms, but nothing so great to drive us to add massive amounts of GPU racks to our clusters. With OpenCL coming available this year, the programming model is dramatically improved and we will see a lot more research and prototypes of code being ported to OpenCL.

I feel we are still in the research phase of GPU computing for HPC (workstations, a few GPU racks, lots of software development work). I am guessing it will be 2+ years till GPU/stream/OpenCL algorithms warrant wide-spread adoption of GPUs in clusters. I think a telling example is the RIKEN 12petaflop supercomputer which is switching to a complete scalar processor approach (100,000 Sparc64 VIIIfx chips with 800,000 cores)
http://www.fujitsu.com/global/news/pr/archives/month/2009/20090717-01.html

Reply
RE: Thank you for the proper quote from Nvidia by Yojimbo, 127 days ago
>>If even your typical physicist is scared by the complexity of the >>tool, it's too early.

This sounds good but it's not accurate. Physicists are interested in physics and most are not too keen on learning some new programing technique unless it is obvious that it will make a big difference for them. Even then, adoption is likely to be slow due to inertia. Nvidia is trying to break that inertia by pushing gpu computing. First they need to put the hardware in place and then they need to convince people to use it and put the software in place. They don't expect it to work like a switch. If they think the tools are in place to make it viable, then how is the time to push, because it will ALWAYS require a lot of effort when making the switch.

Reply
RE: Thank you for the proper quote from Nvidia by hazarama, 129 days ago
"Do you see any sign of commercial software support? Anybody Nvidia can point to and say "they are porting $important_app to openCL"? I haven't heard a mention. That pretty much puts Nvidia's GPU computing schemes solely in the realm of academia"

Maybe you should check out Snow Leopard ..

Reply
Comments Page 1 of 17

Deliver Rich Interactive Experiences
Engage more viewers with Adobe® Flash® Media Interactive Server 3.5
Vinpower DVD Duplicator
Manufacturer of quality disc duplication systems. Drop shipping available. Become a reseller today.
Unlicensed Software at Your Last Company
Anonymously Report Unlicensed Software with Our Form Now. Get Up to $1 Million.
Special Offer from The Economist
Get 12 issues of The Economist for $12. US subscribers only.
Unlicensed Software at Your Last Company
Anonymously Report Unlicensed Software with Our Form Now. Get Up to $1 Million.




Latest news by
DailyTech

 February 9, 2010

Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank

 February 8, 2010

Blank
Blank
Blank
Blank
Blank


more Video Card Discussions



pipeboost
Copyright © 1997-2010 AnandTech, Inc. All rights reserved. Terms, Conditions and Privacy Information.
Click Here for Advertising Information