yes if you're careful but wouldn't it be easier to uninstall? e.g. via add/remove in the control panel?
edit: personally I use easycleaner: http://www.majorgeeks.com/download414.html
Note that this is not a download endorsed by the forum. I've used it a few times and not had any problems. Beyond that you use it at your own risk.
The difficult part is FINDING all the registry references ;) Removing programs the way you describe is a silly procedure. Using Add/Remove programs is far more sensible, and the use of a decent Uninstaller program to monitor your istallations and ensure that every trace is removed wieh uninstalling is the best procedure of all.