Sounds like you have a sticky key, (tab key maybe?). Either that, or you have built in 'funtions' in that keyboard and its driver that are doing things you'd rather it didn't.
Look in your control panel, under Printers and Other hardware, look for Keyboard, open it up and see if there's any options you can change. If there aren't many options there, look in your System Tray, see if there's a little program in there to adjust the keyboard settings.
If that doesn't do it:
Try a different keyboard.
One last thing, is it wireless? If so, it could be interference of some kind.