Well, the first thing that comes to mind is; what operating system do you use? Is it 32bit or 64bit?
A 32bit O/S cannot address more than 3.5GB of RAM. So if your graphics card takes the .5 that only leaves 3GB. Any more will not show up in windoze.
You can still, however, check that it's detected but not used. CPUZ and the BIOS should both show the total RAM. For simplicity I'd
get CPUZ from here (d/l in top left hand corner, it's free) and see if it's detected, just not used.
If you are using 64bit there may be a problem (like an old BIOS or something) but we'll cross that bridge if/when we come to it.